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FORKWORH 



In rvcvnl years, as iiist 1 1 ut ioiuil rosotin-es have dwindled and demands 
for aeenunlahll Ity from students, faculty, the ' community , and state 
aKt'nvIes have Im-reased dranuit Ica.lly , Institutional research has 
beeome even more essential for comnumlty collene management than ever 
hefore. Derision makers are depending, Increasingly on accurate infor- 
mation for surli thin>;s as assessing educational needs, allocating 
resourees, assessing institutional effectiveness, and coordinating 
data collection and analysis. 

The lQ7f) Conference on Institutional Research in Community 
Colleges, held at the Henry Chauncey Conference Center in Princeton, 
New Jersey, was designed to meet the needs of developing professionals 
in institutional research, planning, educational development, and. 
evaluation. In this volume, we offer the papers that were presented 
at that conference. The autliors explore such questions as: What is 
the role of research in community college management? What emerging 
Issues, problems, and concerns need to be addressed? How does research 
relate to institutional p.oals, planning, and evaluation? What methods 
and techniques are used in effective institutional research programs? 

We are grateful for the opportunity to offer these stimulating 
papers which, we hope, will contribute to a broader understanding of 
the vital tasks of institutional rcF earcli in community colleges. 

James R. Denfen 
Director 

V' 'grams of Continuing, Education 
national Testing Service 
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.Kiim-'s ( , Vat tent arper 
DifL'.aor, InstiCuLe of liiRluT Edumtlon 
inh/tTsltv of Florida 
tiwi ut'svi Flori da 



An I'N.inin.it ion oi tlu^ Lillet, of the monographs Jossey-Bass haa pub- 

MsIumI iniiirr tlif v;t»nrral >t'riL»s ralU'd Now j^j/,^\c ^,i-O J\ ^, ^pr Insti tM*> 
t [ ( >n a 1^ Kt^s^ij a i \:\\ prn\*idc»s t basis lor assessii))L; thu currLMit nature 
o\ institutional resL»arcIi in institutions nt higher' educat Ion . Those 
t i I Ifs .ire : 

I . ^.' a 1 u a t i\\y\ I ti s ^ ^^[^ ^ A*- V^A-^- ' 

A^:srs-^in^ I'aru I tv K t t ort 

I'l 'wa rd At f i rma t i vo Al t i^n 

Oj-^aii i ^- i}^ ^ \on- 1 rad i t iona 1 S t udy 

K V a I ua t^Jj\j; S t . i tow i lW\ U o a r d s 

A';soss l nv> HL^^.^.'^.^. 

Kes j nnuli t o Chan^in^ liuman Resources 

Mras n^r I ng and I no r e as in /^.^.^/[^"^A^. ^A^,^J-X 

As s e s sjj vg^ ( -^^"^ PJ-^ ^{^^.^p}^ 

V. X am l n i n^ ^^*'^\'l^.^^^^'"L^ji* ^^^^^\*^l^^-^'^'^^t: 

Thi»se titles as well as the various chapters In each monograph 
written hv persmis who are more often than not professionally In- 
volved in Lust Ltut i<nial research provide an observer with a basis 
lor asserting that Institutional researc'a must be beginning to 
assume its potential role as described bv Hugh Stickler almost 20 
years a>;o, 

t 
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Stickler, along with Brumbaugh, Roueche, Cook, Swanson. Doi, 
and Van Istendahl had attempted to define institutional research in 
a way that made it an operational rather than an esoteric concept. 

Stickler said that institutional resear/i . ,is directed 
toward providing data useful or necessary in the making of intelli- 
gent administrative decisions and/or improvement of a given institu- 
tion of higher education," 

The monograph titles represr^nt not only the direction that in- 
stitutional research has taken more recently but also the depth that 
management currently requires. As management has improved, informa- 
tion requirements have increased. 

The Nature of Institutional Research 

In the operational concept of research, "puro" research is that 
which advances the frontiers of knowledge and which at the moment 
of discovery may seem to have little or no practical application; 
"applied" research is that which is designed to answer questions 
and to aid in solving problems, \;hile this dichotomy may be 
entirely too simplistic, it does provide a useful basis for insti- 
tutional research design. The nature of institutional research is to 
carry out activities that will provide data for improving the college, 

A program of institutional research does more ^.han compile 
data, however, Unfortunately, much of the institutional research 
conducted by junior colleges pricr to 1968 has been judged as 
worthless "because of faulty design, poor methodology, ungeneral- 
izable findings, or just poor quality. . ." as assessed by 
Roueche and Boggs(l), Turner subsequently agreed in 1971, It seems 

erJc 



doubtt'ul that appreciable Improvement has developed in the few 
years slnoe l^ifiH, even th(iu«h nany Institutions have provided a more 
serli.us allocati.m of resourcfs to this specific activity than was 
previously true. 

What Is the nature of a good Institutional research program in 
a community college.' Referring to tho monograph titles, the nature 
of a program of institutional research consists of a formative 
systf.nattc evaluation procedure focused upon the institution Itself 
and such areas of Inquiry as: institutional goals, students, faculty, 
curriculum, administration, facilities, and the community, as well as 
a continuing analysis of financial support and expenditure patterns. 

Cook's studv in 1971 identified areas of inquiry in their 
order of prlorltv, according to 2J5 jurors who were deemed to be 
representative ol the community college professional cadre. This proup 
gave highest priority to topics concerned with students: enrollment 
trends, profiles of student characteristics, student attrition, and 
other follow-up studies. They -also gave priority to studies dealing 
with Institutional goals, especially as they relate to the community 
envlrcnnionr and as thev may he evaluated as adequate statements. 
Cook r.-portod that other areas of inquiry relate to curriculum, man- 
agement, and institutional c-jntrol of operations. He also re;jorted 
that studies ot administrative policy and procedure were not given 
much support bv the jury. 

The nature ol institutional research is a process of data 
gathering that can be directed or 'ocused by the proper questions. 
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lliL'st* ([lU's 1 1 oiiH , vhcn CO r rod I y Iramed, establish the boundaries of 
I list 1 1 in l<>na I r^'S'»arv'h iw an institution, Kor L'xamnlo: 

I. W^.at I'llict doc?s probation status tiave upon students? 
J. , Wh*U teai'hlnrt p rocodurc's are most cos t-e t i ec t ive V 

What scheduif providt^s the most effective use of facilities? 
4. What new programs will tlie community need bv 1980? 

Wht-re w>li noncrt-dlt courses be needed within the area? 
Tlu'Sf kinds of questions will provide data that can be used as 
ii' basis lor poIl».'v and action. 

It is Important, however, especially in view of conclusions 
rt'lited ab(jve concerning the quality of institutional research, to 
gather data in a soundly designed research framework. Too often 
researi'lj methods have included one or more of the following types 
ot' study design or *ipp roaches: 

I, r he Pooling o^' Ignorance. In this study design, an uncompli- 
caieii ''r.allnp'^ Poll is used to acquire di-^ta in an area 
whlcli requires expert and. exper ienced opinion, Tiie result 
is statistical analysis of ignorant opinion, 
J. Pe rsua^^^ v^t; .^.^.^A^/^.^'."^'^;'^ * • this approach, a position de- 
ten<led bv inViilid assumptions or by "common sense" logic is 
t.iken and never abandoned. Any opposing position is beaten 
down through repetition and logic not necessarily based 
in t.ict. 

K Apjeal to Author i^tv^. This study technique includes a plethora 



1 qui^tations selected because thev arr* in print and because 



t hev 



b'.rec^ witli an .lujiwer pt'i-viouslv deternifneil to be tin' 



Ci M" fee I one . 





^- Professional Confidence. This design values data which 
validate a personal experience and rejects data which 
do not confirm a position determined by earlier conjecture. 

5. Parroting. This approach places heavy emphasis on what 
others are doing. The assumption Is that If enough others 
are Jolng It, It Is goo. 

6- Intuitive Determination . .This design supports a position 
because It seems so right. And It Is, of course, as 
everyone knows. 

Pierce described a similar concern for proper design when he 
contrasted the method of science with research design base upon 
tenacity, authoritarianism, and a priori procedures. So the nature 
of institutional research may be described both in terms of areas 
of inquiry and appropriate methodology. 

Suslow defined the nature of institutional research for the 
Association for Institutional Research in 1971. He emphasized 
that institutional research is an attitude and he described the 
research activities as the systematic appraisal of the higher 
education effort through critical appraisal and carefnl investi- 
gation of its processes and programs. 

He concluded that "If the appraisal is not systematic and 
factual, if it is not concerned with commonly accepted higher 
education values, if it is more or less continuous, then it is 
not institutional research." He emphasized formative evaluation 
of purposes and values as well as efficiency and productiveness. 
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How Inst lt\itloi)aI research stmuld be u;^ed depends upon both the 
natinv ciihl rl,e qiu^llty .)i ihe resuarclu Here again, the Jist of the 

JlL^'-^'-'JJ^'Jli f^t^nugraphs prt.vides-' a summary ot the current uses. 
rr.MirL'valuatiny; ciie lacultv t,o improving the curriculum to allocating 
tvsourrL's. ti'.u uses of inst i tut: ional research data are obviously 
ivqufred lor Si)iiiul operation, I)av~to~day decision making as well as 
tonK-ran^t' pKunUim depend on data that can best be provided through 
a sdund ins.f 1 1 iit I ona I research program. 

m.th tliese concerns as background, a list of guidelines may be 
expressed as a basis tor community college institutional research: 
^' iL^A^illLL^A .-U'^^V^^^,^>' P^ Vv of resear cln The community college 
is a service-oriented institution, net a ce. ter for b.isic or 
pure researciu The overall goals and purposes as well as the 
commitments ot institutional research must be clearly stated 
and commonly understood. This philosophy must fit into the 
overall institutional philosophy, its role, and its scope..-'" 
Hm^ua r esj^^ns Lb i 11 ty for the ac t ivi ty . Everyone's job. Is no 
one's job. All administrators know this, yet a number of 
community colleges still have no designated .person who is 
responsible tor institutional research* JJomeone must be 
appointed to coordinate all types of institutional re- 
search in a col lege, 

^-^ .t ah^ish a rationa l p osltion in the organization structure , 
lines of responsibility must include both superordinate and 
subor.linate. There are several alternate patterns; no one 



ran claim to havo »i Lest structure. Each must have a ra- 
tloriiiU' \/lilch dt'UM)sihle tor a specific sltuatiOii, 

ptH'L.mt thiiL Laculty also teel a responsibility for Insti- 
tuLiiMi.iL rt se.'in h , This Ls hest done through an advisdry 
(■(immltteu thai rep rt'scnts all elements of the faculty. 
Arra nge' lor A^J^A"> ' ^ ~^}^PPPJ-^^* should be ob- 

vious that nothing happens wltliout resources* Industrial 
firms inav allocate 13 to 20 percent of their budget for 
research. Colleges tr-st likely do not need that high a per- 
centage, hut there should be ' a clear designation of adequate 
funds to do the job I 

IMan researcli ca^re fu lly. There are a number of ways that 
Institutional research Influences institutional management, 
Since studies often require data from several sources, care- 
ful planning will saye time as, well as other resources, 
Se e k b r o a d a cu lt p a r 1 1 c Ip a t i on , Faculty should noL only 
participate through their advisory group activities but also 
suggest studies and take an active role in collecting and 
interpreting data. Time off and otlier encouragement to 
participate should be available, 

rrjjvi de expert lie Ip when need ed . No faculty includes ex- 

4 

pertlse in every possible arda. Use of outside experts will 
not only enhance the study but will assure possible com- 
parahility and sliared position. 
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i!iil!SjLlll^JE^^ <^ne of the most im- 

|)ort;<mt lactors in Flurhla is Cho organization of the Tnter- 
li.st itutu^ .nal Research Council, a consortium of community 
colleges and the Tniversity of Kioriila for the purpose of 
cooperat ive research. 

process, I'he problem of record keeping is a difficult one. 
I^rocedures can be established, however, which will assure- 
both accuracv and completeness. A cross-reference system 
will be invaluab le. 

11. rj^)^\^de adequate recopnitton. Faculty who conduct studies 
obviously need the support ot the institutional research 
ottice. There needs to be a specific program of recognition 
provided to those who complete studies. 

^ ^ • HstabLls^h ^a proced ure I'or dissemination and discussion of 

t i ndin^s . Shelving a study is all too often the final result, 
Concern tor follow-through is an important part of the study 
design. 

^ ^- ^'A^' A^V*-'. improving the institution . Direct use 

ot. the iitidings will be the most important outcome. If this 
step is not taken, resources will be wasted, 

I . IM-i Wide empathetic ^ ^tpport f ro m the president of the 

inst L ttit ion . ' Research has repeatedly empliasized the need for 
lop- level support. Institutional research has failed its 
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mission In tliose I legos which do not have clear support 
tr<im the president, 
lese miliU* lines provide a has is tor the development of'ftn 
Institutional reearch program In a community college, The imple- 
mentation ot them will require hoth commitment and planning, individ- 
ual Iv and Institutionally, 



l. Ko'ieciie, John K,> BoRgs, John R, Junior Collej^e inst i tut ional 
rese arcli - the Mate of the art, Washington, D.C.: American 
Assoc. ot Junior Colleges, 1968, 
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TOE RANGE ANO ORGANIZATION 
OF DATA FOR RESEARCH 



Richard L. Alfred 
lUrector of Educational Research and Development 
Now York City Community College 



Emerging research trends in the two-year colleges indicate that three 
major devf^ lopments are now beginning to take place. These develop- 
meats have come about primarily in response to a need for aid in 
decision making and have closely paralleled the Increased emphasis 
on accountability that has become the hallmark of the seventies. 
Perhaps the most significant development is a new emphasis on applied 
rather than theoretical research, which has led to an increase in 
useable rather than abstract models. The steady increase in the 
number ot research projects devoted to specific problems rather than 
Investigation in general clearly reflects this shift in emphasis. 

A second development is the redefinition of functional objectives 
In institutional research. The focus is now shifting to such matters 
as enrollment projections, outcomes in career programs, economics 
tmpiK'ts (of the college on the community), cost effectiveness, ad- 
ministrative organization, institutional goals, -ollege governance, 
instructional e f Lect i veness , community needs, and many related topics. 
No longer do studies that merely tabulate student characteristics ful- 
fil 1 tin* Inr<innation needs o\' potential users. Needed now are studies 
that concentrate on specific areas and individual needs rather than 
general student characteristics. In addition, surveys are now re- 
qulrnl to determine the educational needs of particular segments of 
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the population such aa rural and urban groups, ethnic minorities, 
elderly citizens, and women. 

Finally, Institutional research has become more sensitive to 
tl)e need for empirical information as to whether the community col- 
lege meets the expectations of the community and legislative agencies, 
A premium Is placed on information related to the quality of impacts 
pnnluced the college as contrasted to those imposed £n it by the 
individuals and groups using its services. This development is clearly 
reflected the number of recent studies conducted to determine stu- 
dent outcomes in the educational process, 

Res e^ arch^ Coiicep tual L zed 

Given this emphasis on the practical aspects of research and the in- 
formation needs of faculty and administrators, we can define research 
AS a* process designed to assist institutions in: (1) defining goals 
and purposes; (2) identifying programs and policies that meet these 
goals; (3) evaluating programs to see if they are doing what the 
institution says they are supposed to do; and (4) mapping the flow of 
resources to determine the cost effectiveness of college programs. 

There are many sources of data, ranging from the expressed 
needs of community subgroups tp the published requirements of state 
agencies. The value of such resources for a particular organization, 
liowever, depends on the efforts of many to collect, organize, and < 
applv the data In the deeision-making process. At its best, research 
data Is a constructive tool for management to use in making key 
decisions; at Its worst, It is a useful adjunct to the decision-making 

1.' ■ 



pn)i'.'';s--nrti»ii jusl wlndnw drrssliiv. \ nr Ji»^MsIons that havu already 



M "t» ver»» to clums*- which role we want reyearcli to play, 



must of us would proluihly select the more conHtructive role. We 
wouhl say that to he etfeotlve research should have a direct effect 
on decisions concerning institutional goals and purposes and should 
also att'ect the niechods by which these decisions are made— that is, 
c^ter the structure o\ the decision-making process. For research to 
liave such an ettect on de-ision making, it must meet three essential 
conditions, Kirst, It sh.juld help faculty and admin Is Orators estab- 
lisli Institutional ^oals and objectives; second, it .should play an 
inteKr^l part in planriinK; and, third, it should provide the moans for 



appraisal ot Institutional programs and activities in relation to 
stated goals (evu luat Ion) , 

There are several assumptions upon wliich these conditions are 



• Kacin^ an uncertain future, administrators are sensitive to 
the need for research to assist in the formulation (or 
modi f ication)' of Inst i tut icnal goals. 

• Research, as an integral part of the decision-making pro- 
cess, should both precede and follow the establisliment of 
Inst ( tut ional goals, 

• Kesearc.h, as a pivotal element In goal-setting, should 
play a kev role in planning for the long-range development 
ol tlu» inst Ltufion, 

• A rrcoyuii^ed apparatus exists in every institution for the 
^conversion of research findings into planning concepts 
and dec is I i>n alternatives, 

• Tomprehens I vo data systems, once organized, . will be used 
hv tacultv and aibi I n i st ra tors to guide the further de- 

vi lopnient ot the Institution through variable Internal 
and exLiM nal rondi t ions. 



h«lsed : 
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li ,vt' rail »uH't»pt thrse roiulit ious and assumptions, then a roncep- 
lual l.Muulatlou ?nr rrsearrh will have heen t*stablls[ijd an'd a system 
dt*slKnt'd tor its ur^anLzatLon Into data tie Ids, 

riv;iii*i' I un pa\;i' 1 is i dii};ram of tUv I'onr rp tua I model jiist 
dt'srr Ibfd , This model idcntLtics lour subsystems In research? goal- 
settiu)^, program development, eost e L f ec t i veness , and program review, 
Kaeh sul)svstem has a distinctive relationship to planning and de- 
i- Is ion m.ikiu^', , and each has eomponent data Fields that identify and 
<ir^ani/.e In format ion Into su'jjeec categories, These data fields are: 
sLudeuts, p n>i* rams commun i ty , facilities, .iLnance, staff, and organ- 
i zat 1 (Ui , 

All seven ot the data tields operate in eacli subsystem but do so 
prim.irilv In accord with cheir relationship to the sequence of acti- 
vities in tlie Institution, Kor example, data that relate- to godl set- 
ttui* ivpicallv tnvelve the nature of the community to be served and 
are colJi'i-ful f»arlv in the life of the institution, Data related to 
pr(M*.raiii drve I opiiien t. are n»'eded at a later staj e In the Institu- 
ti«»n's developi-ent lor jnarket analyses and eormunity need surveys ' 
to identily the tvpes ol programs that sJ-Aild be offered. And, finally, 
higfilv s;-ecific d.ita related Lo the Cost effectiveness and program 
revi»'w sub svs terns are desi>;ned to describe the outcomes and costs of 
colle^*' programs and relate them to the goals of t!te institution, 

FU'fnre dtsrussing in greater detail management's use of re- 
^I'ari-li d<aa lor planning and decision making, let us consider 
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Kigure 1. Conceptual Model for Reaearch 



brletly the tour subsystems and the types ot data tliat are incor- 
pnrattui Into eacli. 

^iiilli^iliJULlit' Most twn-yeai 'jolleges develop a general set of goals 
based on a philosophy tormulated at an early point in their develop- 
ment. SiU'h i;oals recelvv* little attention except in relation to 
visits from re>;lonaL accredit ing associations wlien an attempt is 
made to reliite them to descriptive data collected after the fact to 
demonstrate that the goals are indeed being met. Unfortunately, these 
goals normal Iv are abt defined in sucli a way as to make them effec- 
live in guiding Ln.st itutionai development. Neither do they receive 
the regular review and evaluation by faculty and a^mininstrators 
that could make them a vital torce in management, 

F.verv Institution should collect data tliat can become a source 
ol direction tor determining the types of goals it should pursue. 
It is not enough tor a college to commit' itself to offering career 
programs slm[)lv because this is a goal normally pursued by a com- 
preliensive community college, ideally this goal should be deter- 
mined In accord with^data describing regional and local needs for 
career programs. It should be phrased in terms of the total percent- 
age ol enrollment to be served by sucfi programs, th^ relationship of 
these programs to manpower needs of the community, and the actual 
numlier ot positions to be filled by program graduates. In a similar 
lashion, a goal concerning guidance services should identify through 
research the kinds of needs students have for such services as well 
as the anticipated results. Obviously, the formulation of goals based 
on research diita will not he easy in many areas, but the effort must 
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be made n goals art^ to serve as a yardstLck tor i ns 1 1 tut i onaJ de- 
vo Li^pniL'ti t , 

Tlu- lolloping areas of concern in the goal-setting subsystem 

neod to ])o addressed bv t'ommunlty cu.l le>'t? roKoardi: 

Ccrfminitjf 

(j) Studlit^ o: t-he >;oograph;ca L cnar acterist ics ot the college 
servico reg'lAn 

i>\zt (in sqaare miles) 

d Ls t r i b ut 1 c n ol popu lat 1 on 

zoning characler 1st ics of region 

natural barrier.-^ to campus development 



(1) 



ti.dies (U' the demographic characteristics of the college 
servi ct» region 

popular ion dens ity 

population composition 



vij;o 

S t * X 

k'^'t'l ot education 
race and etl.ri:* group 



occupitlonal status 
lami ly Income 
dwe 11 Ing uni ts 



• in/out migration (populaticn growth) 

• t r<inspiu-Latl(Mi i acili ties 
( }) Kvi.-'nonn v* s ^ ufl Los 

• number and typos ot business and industrial installations 

• manptnvor distribution (bv occupation) 

• regional projections lor iiiarpower needs (by occupation"^ 

• I a to ot unemployment 

• percentage ot popula' ion employed in "growth'' and "no 
grow til" occupat ioris 
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(4) StinlU»s k^\ postseconJarv institutions and proj^rams 

• number and lypt's of pos tsecondary Institutions in 

• number and types of postsecondar\' Institutions in 
jri»a.s outside service region 

• fareer and general education program offerings in 
postserondarv Institutions 

• community service and continuing education offerings 
in pos tsecondary institutions 

• articulation policies and procedures 

(')) Studies of Individual and group perceptions of college 
yoals 

• Delphi technique 

• Institutional (ioals Inventory 

• other standardized Instruments 

• community needs surveys 

• other 

(h) Studies ot ^tate and regional statutes regulating instltu- 
t lonal goals . 

P rt>g r am^ 1 * Organizing for effective programs requires a 

total i-onL-eptual framework beginning witli a stated mission and ending 
witti a svstem.) L Ll-. approacli to evaluation, Tliis procedure requires 
a market analysis of community educational needs which must he met 
ttirough llii" devr lopment ot programs operated In support of stated 
goals. 

:;urH'r.'u-. market analysis models are available, but tliey are 
all has- : .Ml tho gonral assumption that- educat lonal programs sliould 
bnlh t- li^'v; anvl s\ip|)ort the eduoatlonal needs of the community, 

.Mi p.ivv 1.^ ilopii'ts the various steps in a '^larkel analysis. 



1 / 





Modification of 
Programs 



w 
ft 

a 

o 

rt 
H- 
O 

:j 
I 

ft 
c 
a 
(0 

3 
rt 



Refinement of 
Proqram Objectives 







Program 


Evaluation 


> 




Selection and 1 
Implementation 1 
of Program Objectives 1 



ERIC 



Institutional Goals 




Assessment of 
Institutional Resources 
Relative to 
Program Objectives 



^anpower-Facilities-Financ^ 

Figure 2, Market Analysis Model 
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In every metropolitan region In the United States, census data are 
available that describe the population in terras of characteristics 
such as age, sex, race, ethnic group* veteran status, occupational 
status, family income, education level, and unemployment, PrCtgram 
objectives should follow market projections of community need and 
should be stated In concrete performance terms. They should define 
the types of population subgroups to be served, the types of needs 
that have been identified, and the types of programs to be offered. 
The development of program objectives that reflect research on 
community nee4s carries forward the process through which the insti- 
tution's programs are created. If they are properly stated, objectives 
can enable faculty and administrators to appraise programs according 
to their use of current resources and measure their effectiveness 
against a series of short- and long-range planning yardsticks* The 
types of research currently being collected in this area can be sum- 
marized as follows: 

Communi ty 

(1) Studies of . educational needs and characteristics of out- 
of-school citizens (18 years and older) 

(2) Studies of educational needs and characteristics of 
secondary-level students 

(3) Studies of local employer needs and perceptions 

(4) Projections of manpower needs by civic agencies * 

(5) State and federal projections of manpower needs 
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(I) Appraisals ot state and regional regulations affecting 
program development 

(J) Snullt's of program ;U tilings 1 Lher postsecondary 
Institutlpiis ■ ' 



(1) r.nrol Imeni pl^lie^tLous 

• InsL L'Lut: ion 

• division 

• iepartment 

• I'oursL' 

• sect ion 

(1) Studies ot educational ne^^ds and characteristics of en- 
ro I led studotUs f 

(]) Studies ot student transfer rates between pos tsecondary 
Institutions 

(IV Projections of program costs 

il) Projections ot rt- venues generated by programs 

Fact 1 1 ties 

(1) Projections of amount of space required by programs 
(square l-ootage) 

(J) Projections of type of space required by programs 
(laboratory, lecture, office, and so forth) 



(I) Pr»>jectlons of staffing requirements of programs 
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Program Review; The third ? .bsystem In Institutional research 
is the "program review" or what Is commonly known In educational ' 
jargon as "evaluation." This subsystem Is perhaps the single 
most routinely examined area in community college research today. 
Studies of student attrition, grade distributions, employer 
follow-up surveys, student perceptions, graduation rates, 
transfer performance, and so forther, art good examples of the 
kinds of research ^one in this area. The focus is on student 
outcomes, and the methods that are used are as diverse as the 

., research itself. The best way to describe the subsystem is 
through a diagram of the relationship of outcomes to program 
structure in the community college. 

In theory, programs consist of a series of activities 
designed to move students from one status to another. A model 
developed by Astin uses the concept of "outputs" to describe 
the progress of students in relationship to programs. In this 

.model, the background characteristics of entering students, 
the objectives of the program, and description measures of the 
college environment are considered "input" (see Figure 3, page 
22). Theoretically, an "earpected" output can be computed at any 
time in the life of a program based on these input characteristics, 
and the effect can be statistically removed from "observed" 
outputs (actual scores on the variable or variables under 
investigation) producing a "residual" output, which is independent 
of the input characteristics. Measures of the characteristics 
of the college and the program can then be related to this 
residual output to a;>praise the functioning of the program. 
This process culminates in the formation of evaluation 
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Figure J, Input^Output Model of Program Functioning 
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mearturen which describe program tunctioning in terms of student 
outcomes as well as the effectiveness of the program in pro- 
ducing conditions wliicli lead to outcomes. 

tVoj,;rams can be measured at three different intervals; at the 
Lime of Initial student enrollment (input); during the period of 
enrollment (functioning); and after termination of study -(output) , 
This progression Is reflected in the studies commonly conducted in 
tlie area: 

xnization 

(L) Studies nf the climate and characteristics of thfc insti- 
tut ion 



(I) Studies of the objectives and characteristics of college 
pro^;rams 



objectives 

courses 

staff 

facilities 

Instructional methods 
ins t ruct ional resources 
budge t 
othe r 



(I) Studies of the characteristics of enrolled students 

• basic classification 

• demographic 
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• iHM-i't»ptiia l-att LLiullnal 

(J) Siiulit's o\ KtMdf aistrlbut Iduh (summaries and comparisons) 
(O :;t.udU!S (It the rliararteristlcs of graduating students 
( StudtMii atLritlou studii:!S 

• iuiml-.,M' and iharai'to r ist 1 cs ol students 

• iTtullt atrtrlti.m (course withdrawal) 

• rollo>!;t« attrULi'U (withdrawal from i'ollt''go) 
( >) Kr.sLMri'h .m stopv^uts ^ 

(t.) :;?.udii's un Lranster students (number and destination of 
LransliTs, criHlils areoptod, and so fortli) 

(7) i'r.HiVter lol Low-up studies (academic achievement ot trans- 
I ft .'.tudents In subsequent institutions) 

(H) Studies ot certttication/liet^usure results (student scores 
on required examinations lor career entry) 



(^0 



KfSfareh on further educational degrees obtained by students 



(1(1) Kesearch on employment patterns of students (number of 
stmlt»nts permanently employee by type ot employment) 

(11) Kfsearch (Mi employer evaluations of student preparedness 
and Job performance 

(IJ) Research on studet " perceptions of college 

• «M curriculum (career and transfer preparation) 

• ol t acuity and staft 

• t) I campus lite 

• ether 

(1) economic Impacts of the college on the community 
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Cos t K t I 1 viMiess ; Tiu* tuurLli subsystem in institutional research 
responds to thi* netHl o\ community college planners, t'or a gross 
quciun t.it I vo mtMsurt* ot tlu^ cost e I l e ct 1 veni'ss of present programs 
.n^l tor .in estlin^to clu* major ('onsequentt»s ot* tleelsion alternatives, 

Slnee oiilv fu rt) I Lmt'ii t-ha*sed Intormati )n current ly meets the tiriter- 
lou ol I'rkul i'. i I It V, oost tM" U-i- 1 i voness analyst's have bctMi limited to 
data wliit'li exiinuue nnly tile quantity ot output. At most., this type ot* 
analysis produces c unit cost tor eaeh operation and should more 
apVt'^M^^' i Iv he labeled "eost analysis," 

Si^nie o! the studies that have been conducted in this area, 
whfU r.iken tovu'ther, provide the inv;redients of a unit cost; 



I'TK 

credit hours 

weekly student contact hours 
other 

• levels of analysis 
col lege 
division 
department 
course 
sec t ion 



(1) Studies -of faculty load (allocation of time to programs 
and functions) 

(2) Studies of staff salaries and fringe benefits 



(I) . enrollment analyses 



• units nf analysis 
headcoun t 
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Finanoe 



(1) 



Studies of supply costs 



B'aai li ties 



(1) Research on facilities utilization 

(2) Studies of energy costs 

Sj>eclalized Research Studies: The final subsystem for research is 
made up of studies conducted in response to special needs identified 
^. hy the Institution or its constituencies. Often designed to collect 
riata defined in previous subsystems but for different reasons, thi3 
subsystem. would include the followingr kinds of studies: 

(1) institutional (or campus) feasibility studies . 

(2) bond issue and levy election studies 

O, annexation studies (of school districts) 
(4) institutional self-studies 
(.5) collective bargaining studies 

(6) trustee subdistricting studies 

(7) other studies as may be mandated by emerging issues 
Although this list is only partial, it does depict the relation- 
ship of these studies to emerging issues in community college 
education, ^ 

Planning and Decision Making ■ 

The translation of research dat£V into planning concepts and decision 
alternatives is the crux of the research enterprise. Management de- 
cisions do not simply follow from the existence of research data. 
Whether at the two-year or four-year college, there are persistent 
problems. First and foremost, and for many reasons, there is a need 




to Increase -management's awareness of the value of converting 
research data-^past, present, and futunv—ihto planning concepts. 
Once data on proKrani. outcomes are In hand, management guidelines 
are necessary for their translation into planning alternatives. 
This involves system-wide priorities and requires that administra- 
tors maintain some form of decision apparatus for the conversion of 
data Into action. 

Many administrators have failed to attend to this need and have 
lapsed into lethargy upon realizing that they must assume a leader- 
ship role if planning Is to be successful. The absence of a decision- 
making apparatus allows the accumulation of a hard core of unan- 
swered questions that plague the educational planner: Wliat are the 
uses of research data in community colleges? What procedures should 
be used for the conversion of data into planning? who should be re- 
spon.sible for assessing the implications of various data trends and 
advising management of decision alternatives? What is an appropriate 
balance between politics and reseaich in the planning process? 
How can research data be used to "improve" management decisions? 
What is the value of planning in an institution in v:hich political 
concerns often override planning alternatives? Questions such as 
these must be answered if two-year colleges are to conduct meaning- 
ful research programs. 

Figure 4 on page .28 presents a decision model that depicts the 
environment for converting research findings into planning concepts. 
The render will immediately recognize in this schema the potential 
for conflict in competing staff interests— a situation that has 
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Figure 4, Graduated Decision-Making Model 



proven so dys functional for conmunity colleges. Ideally, planning 
.should bt. a urad^uated process that involves making decisions that 
strt'ke an even balance between political considerations on the one ' 
hand and research data on the., other. Too often, however, political 
expediency haii^ been the dominant force in decision making and research 
ha.s been ;i superficial adjunct to the process. This situation is' 
most evident In the tendency of administrators to manipulate research 
rindtn«s to fit a framework congruent with their value expectations 
when they make decisions affecting the direction of the institution. ' 

Institutional constituencies, depending upon their numerical 
size and Internal cohe.s Iveness , ^ring different value perspectives to 
the decision-making process. To the extent that these value per- 
spectives are Identified and understood, research can be effective 
as a guide to Institutional development. By presenting faculty 
and administrators with different alternatives based on research 
findings, the lesearcii model can be used to forge decisions re- 
gardlnK long-range development. Using available data in combination 
with stated Institutional goals and staff input, decision alterna- 
tives lan be constructed. These alternatives can range from 
a purely political solution to a data-based approach to long-range 
planning. The solution Is likely to He somewhere in the middle, but 
ttie task of Identifying potential alternatives is in itself sufficient 
to point tacultv and administrators in ttie direction of planning. 

in the absence of a decision-making apparatus to convert re- 
search data Into planning concepts, researcti is fragmented. This re- 
sults In a paftern of vested Interests that lacks credibility as an 
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objective bast- tor plarinlng. A decision model should be developed 
that ls,sensttive to the political climate in which an institution 
functions as well as flexible enough to allow time' for the develop- 
ment ot decision alternatives. It should not be assumed that the 
values and interests of college constituencies will always be com- 
patible with research data, but administrators will ultimately be able 
to achieve consensus if they are given accurate and meaningful Infor- 
mation. 
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RESSARCH METHODS AND STATISTICAL ANALYSES 
.FOR DEVELOPING PROFESSIONALS IN INSTITUTIONAL RESEARQI 

James W, Selgas 
Director of Research and Conununity Development 
llarrlsburg Area Community' College . 
Harrisburg, Pennsylvania ■ 



In exploring the methods ana echniques u^ed in effective institutional 
research programs, we might consider some of the thoughts of Paul 
Dressfl (7) . oni: of the country's leading institutional researchers. 
Dresael states that "the basic purpose of institutional research is 
to probe deeply into the workings of an institution for evidence of 
weakness or flaws which interfere with the attainment of its purposes 
or which utilize an undue amount of resources in so doing. In the 
search for flaw?, no function, individual, or unit should be regarded 
as off-limits. In the process of searching, evidence of effective 
and, perhaps, excellent functioning can and should be produced, but 
perfection is unlikely to be found and improvement is always possible. 

In carrying out this process, " what is the grist for the mill? 
Dressel sees 'three main subjects— the environment, which includes 
the individual constituencies on the campus, i.e. students, faculty, 
administrators, plus facilities, and, in the case of the community 
collt'se, the conununity* 

Tho second subject of uistitutional research— the processes 
and operations of the Institution— includes' a great many items which 
essentially rt! fleet the administration of the institution. The three 
main luios an-: .1. Student Personnel Services including such 
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Hubg'roups as admissions, counseling, and financial aid; 2, Curriculum 
>, and Instruction Including such items as grading, course proliferation, 
and class h1z«; 3. Business Operation. Dressel readily acknowledges 
tha. "inst Itutioncil research personnel can seldom deal effectively 
with them unless they have Impinged rather directly on . the academic 
program and have become a source of concern or complaint from academic 
units/' This situation 1^ prevalent at my institution, and I see it 
at many others. [R simply does not mess with the Business Office, 

Another, subject of Institutional research. Ultimate Outcomes, 
should be distinguished from immediate outcomes such as degrees and 
certificates. Most IR offices deal with immediate outcomes. Immediate 
follow-up studies are common. Long-range follow-up studies may result 
in additional insighf into ultimate outcomes, A few of us have been able 
to assess the impact of our graduates on society, assuming that such an 
impact is related to their experiences at our institution. 

We have stated the basic purpose of IR and have identified Its 
subject matter, as perceived by Paul Dressel. In the time remaining, 
perhaps it. would be best to express some concerns about IR and com- 
munity colleges, cite some useful references for research methods and 
statistical analyses, and tic them to some of the projects at Harris- 
burg Area Community College. 

lliere is a serious question as to che' quality of research in 
community colleges. Pr. Cohen's comments in A Constant Variab le(4) 
are relevant. In reference to research personnel at Junior colleges, 

he wrote that *'they are frequently inexperienced in the use of 

c 

standard methodologies and while they are learning them, the 
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methodologies themselves are being questioned. " A good example of this 
Is a briet paper entitled ^'College Education for Young Criminals Pays 
Ott.** The title reveals the sophiKtlc^tlon or lack thereof of the in- 
dividual who carried out the study. The report describes a study of 
young men at a correctional institution in Pennsylvania pursuing 
courses given by a community college. The experimental group con- 
sisted of prisoners who were taking the college-level courses, V,\e 
control group was a random selection of prisoners who were not taking 
the courses either by choice or because they had been screened out r 
of the program. The investigator was able to come up with several 
ditferences in tavor of the experimental group. 

The design of this study is grossly inadequate and cannot be 
considered even quasi-experimental. There is a considerable amount 

' {}( screening before an individual is permitted into a college pro- 
^•ram at most penal institutions, especially the one being studied. 

\ Thus , the creme de la creme of the prison population is in the 
college program. 

A briet appendix to the study indicates a gross lack of control. 
The average IQ of the noncollege group was 98.2. The average IQ of the 
college group was 107.7. The average standard achievement test guide to 
thci noncollege group was 6.3. The average standard achievement test 
grade of the college group was 8.5. The point is, the so-called ex- 
periment was loaded in favor of the experimental group. However, even 
with such a heavy loading, there are only nominal differences "be tween 
the two groups. Tlie investigator states, "an important factor in; the 
success rate appeared to be the growth of a positive attltudinal 
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change as Induced through their own recogaltion of having latent talents 
which hitherto had been submerged within the realms of thelt previous 
criminalistic experiences/' It Is this type of verbiage and lack of 
understanding of research which does harm not. simply to the Individuals 
immediately Involved but to the entire field of higher education. 

According to Dr, Cohen, "the constraints are characterized by 
the following concerns by directors of institutional studies: 1, the 
only advantage to being a research officer on some campuses is to 
attend conferences and workshops; 2, the major function of some 
research officers is to write grant proposals, answer questionnaires, 
and reply to requests for data; 3, some administrators try to 
torpedo studies becausa they feel studies interfere with their 
authority; 4. sampling techniques can sometimes not be used because 
a higher authority floes not trust samples and insists on using the 
total population; i. some administrators grant permission for 
studies only if they are safe of will not have unpleasant repercus- 
sions; 6. members of accreditation teams sometimes feel changes are 
too liberal, even If they are supported with data; 7. data are often 
either misinterpreted or not used; and 8, if reports of studies are 
u<.)). r^Jr.»:o;' two pages, it is unlikely anyone will read them," 

Some ulijei ul f ereiuit^ 

Thitrt' are several rettM'ences wh^cfi you may find of considerable use. 
In the area of statistics, theri> nrp. rt\<'iny j^ood texts, I find it 
luMov:ui u^ie imes that follow a decifi !•;);• ni.-iip. The Survey Research 
C.j'.nLcr at tht? V;.\ivevtiity of Michigan publishes \ GuJ. dj^. for Sel ect- 
injg S tat is t ( c al Techni qj AeP_( or Analy zing Socici I Science ,P^t a(3) . 
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Another very usetul text Is In t roduc t ury S t at is 1 1 ^ A ^Pecia io.ti 
Ma^ (10* This text is now Just coming out In a second edition which 
I have yet to review, Ot course, there are other texca on statistics, 
but these help you to identify the right test quickly. 

Probably the best overall text to introduce anyone to the field 
of research in the social sciences and education is Fred Kerlinger'a 
Founda ^ tions of Behavioral Research; Educational and Psychological 
Inc^uiri es (Holt, Rinehart & Winston, New York, 1964). This type of 
text will give you a'' good introduction to the field of research 
methods without overwhelming you. 

The Handbouk of Research ^ on Teachin^ (9) published by the American 
Educational Research Association goes beyond Kerlinger into a nar- 
rower, more detailed field of research, teaching. The text as a 
whole is a monumental document, but one chapter, "Experimental and 
Quasi-Experimental Design for Research on Teaching" by Campbell and 
Stanley, Is an outstanding piece of work which should be read 
thoroughly by any institutional researcher. The logic and design laid 
out In a simple chapter (which has been published separately) helps 
to orient the re'searcher to avoid thr pitfalls of reports like 
Co^l le^e ('duca Ucm for Voiing Criminals Pays Off, Thiti work by Campbell 
and Stanley is the basis for many other texts dealing with research 
design and is constantly referred tc. 

Another excellent referenr'^ only r?cr.tl:ly publ.iahed is the 
Knc vclopedla o!' FAlucational Kvah ia tion (l ) , Its primary authors in- 
clude Anderson, Hal I, and Murplvy from Educational Testing Service, 
In their preface, tho autliors take a critical look at the field: 
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"we do not claim to be. coinpU'tely objective. Rather early In the de- 
velopment ot the book we decided quite deliberately to let some of 
our values and viewpoints show. TIiuh, tiie reader will diacern, 
among other thing.s, that we pieter objective evidence over teatimony; 
Insist th.it measurement and evaluation, even though they are closely 
linked, are not the same thing; favor mlnlmi^lnR the jargon of evalu- 
ation and hUhli^htlnK Us conceptual underpinnings; respect good 
experimental and quasi-experimental designs for evaluation studies, 
and believe the fariure to use good design is sometimes as much a 
matter ot poor tliinklng as It Is of practical pressures; place a 
high' value on the construL-t validity of measures; feel that a great 
deal needs to be done about Improving the climate for and support of 
evaluation studies; want to substitute considered analyses for tl.e 
mystiques that seem to be growing around such concepts as account- 
ahilltv and crl terlon-retnrenced testing; and th^.nk that the conur.on 
aspects ot educat'on and training should be emphasized rather than the 
distinctions." Tlielr work succinctly summarizes many items which are 
often glossed over or are not clear in texts on statistics and 
methods . 

There are several texts dealing with evaluation which would be 
well worth vour review. Suchman(2J) and Stuff 1 ebeam(22) will give 
yon hackgrc ind In evali-athm theory. Wcntllng and Lawson(27) provide 
a guide to evaluating programs. Llptnn(lf,) and Struening and 
i;utentaK(-M) offer v.ihimes wtilch give examples of substantial appli- 
cations ot ttie abstract concepts Involved In evaluations. 
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Sampling Is crucial to studies if we are to draw valid infer- 
ences from the data. Many studies fail to recognize the limitations 
uf samples and/or have a totally invalid sample for the purpose of 
the study, Seymour Sudman has recently published Applied Samplin^ (24) , 
which is a bridge to understanding sampling theory and methods for 
the less mathematically inclined investigator. His other texts, 
Reduc i 1 1 le^ Cost of s u rvey s. ( 2 S ) and Response Ef fects in Surveys (26), 
should also be helpful for designing studies involving samples. 

As community college researchers, we are not usually involved 
in highly technical- research. Instead, we are dealing with immediate 
practical problems. I'here are some handy references to help us ch^rt 
our way through a problem. The following four aio good: 1. Piofea- 
si una! M ai^ l Surv eys (8) can help you organize your approach to mail 
surveys, which community college researchers use to meet the demand 
ior follow-up information; 2. Evaluation in Education; A Practi- 
t ioue r ' s (lulde ( 10) Is another text with an applied orientation, this 
time 111 terms 6f the assessment of instruction; 3. Practical Research ; 
Planning a mi Design (15^ gives you a '>ood overview of laying out and 
following through on research stu' » of many types; and, 4. one of 
the moHt comprehensive and helpful little books is the Handbook 
i ll Research and Evalviation (12) . In a chapter entitled "A Guide to 
Researcli Designs, Methods and Strategies/* the authors discussed 
nine research methods which would be useful '.i review here, 

^^\"V^ t ho ds 

The purpose of the hlsto ri ca l method is to "reconstruct the past ob- 
jectively <uui accurately, often in relation to the tenabllity of a 
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hypotheHis." We may occasionally become involved in this type of re- 
search in looking at trends to help guide us in projections. 

The dc.scrip,.^y^^ method is meant to "describe systematically a 
situation or area oi interest factually and accurately." Examples would 
InL-lude population census studies, public opinion surveys, and some 
follow-up studies. 

The purpose of the developmental method is "to investigate pat- 
terns and sequences of growth and/or change as a function of time." 
An example of this would be a trend study projecting the future 
growth and educational needs of the community from past trends and 
recent building estimates. 

Researchers use the case and field method "to study intensively 
the backRroimd, current status, and environmental Interactions of a 
given social unit: an individual, group, institution, or community." 
Case studies are useful for getting into an area of concern, but 
seldom lead to conclusive results. One pitfall for researchers is the 
selection of a unit Lo hias the results in the desired direction. 

The correlation mettiod is used "to investigate the extent to 
which variations In one factor correspond to variations in one or 
more other factors baaed on correlation coefficients." An example 
would be a study to pn-llct success in college based on correlations 
of college grades and selected variables such as age and high school 
rank in class. Kerlinger and Pedhazur's( U) text on regression 
analyses will be helpful if you pursue this method. 

The c_a,us.a. l -c ump a ra 1 1 ve or ex-post-f acto method is used to 
"Investigate possible cause-and-ef f ect relationships by observing 
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some existing consequences and searching back through the data for 
plausible causal tactors/' For example, this method can be use.d to 
Identity factors related to dropout problems in a particular college, 
using data from records over the past 10 years. 

In the tiye experimental method, the researcher attempts "to 
investigate possible cause— and— e t fee t relationships by exposing one 
or more experimental groups to or ^ or more treatment conditions and 
comparing results to one or more control groups not receiving the 
treatment (random assignment being essential)." In a college 
setting, for example, researchers might examine the effectiveness of 
three methods of teaching reading to developmental students, using 
random assignment of students and teachers to methods. 

With q^uas l -expe r imen tal methods, the purpose is "to approximate 
conditions of the true experiment in a setting which does not allow 
the control and/or manipulation of all relevant variables. The re- 
searcher must clearly understand what compromises exist in the in- 
ternal and external validitv of this design and proceed with these 
limitations." 

Finally, we have the action method of research. The purpose here 
is "to develop new skills and/or approaches and to solve problems 
with their application to classroom or other applied settings." In 
short, we may wi>rk In an area without a tight design, recognizing 
the limitations of any data while generally building toward a 
better design. 
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ReHearc h Methods at a Cunnnunlt y College 

neaertpttve Method; At Ilarrlsburg Area Community College, we have 
umtertaken a rather ambitious descriptive research project— a com- 
munity educational needs assessment (CENA) . This proje-ct is a key 
component of a five-ypar master plan we are currently developing at 
the colU-ge. The results of the study will provide information to 
other components including staffinR parameters, enrollment parameters, 
new curricula, facilities, and the fiscal plan. The key point here is 
that descriptive research can be quite useful, indeed crucial, to 
sound planning. 

The study Includes a survey of a stratified random sample of 
the JO high schools In our three-county service area as well as a 
survey of the population at three a.. a vocational-technical schools. 
The design of the survey will permit us to extrapolate the educational 
and occupational plans of tenth, eleventh, and twelfth graders through- 
out our service area. The data should permit us to identify new 
curricula, especia.'lv those which could be aervicied Jointly by the 
college and the area vocational high schools. These curricula 
would result in more post-secondary offerings without any Increase 
In staff or facilities. It may also be possible to identify marginal 
programs which we could start ptiasing out. 

The second component of our study Is a survey of adults in our 
•service area. We are Identifying what, when, where, and to some extent 
how hulIvUiuals mlglit receive noncredlt adult classes and/or regular 
college-credit programs. We are doing general samples of 500 in 
each ot the tliree counties and subsamples In population concentrations 
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whert. extensUm services may be offered. We will be doing a mall 
survey of. the adults as opposed td on-site surveys of the high 
school students. Mail surveys can/be a tenuous business, but we've 
enjoyed excellent community suppdrt In the past and anticipate the 
sam^f* ill the tuture, / 

The final component of our 'study is a survey of the business 
commuiUty. This will be a mail survey Identifying their training/ 
education needs and their willingness to assist their employees 
in obtaining such training bv outside Instruction, tuition support^ 
released time, and so on. 

iX'Ve luj )ment:al Method ; Often, descriptive research may turn into di?,- 
velopmeutal research. In 1972, for example, we did a rather extensive 
study entitled S t ude n t S e r v i ces ; An Eva 1 ua t i on (18), Now, in .976, as 
our institution comes up for a mddle State reacereditatlon, we have 
just replicated the study. (Any time you do a descriptive study, con- 
sider the possibility of replicating it. Consider this in the design 
of the study. 1 should point out a bias of mine: I like to sue 
replication of a study and/or a cross-validation procedure if appro- 
priate. Statistical significance is not always replicated, Replica- 
I tion is .» good way of checking conclusions.) 

I When this study was initially done, I was given the res^onsi- 

/ ' biUtv tor evaluating; our Student Personnel Services to t^nd out. 
whore all the money was going and whether the services to students 
were etfectivc. As [ approached the problem, I found that there 
was little in the way of hard data to assess the performance of the 
Student Personnel Services operation. One could, however, try to 
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Identity some face vaildicy of effectivenss of the various opera- 
tions, finding out how various constituencies on campus felt about 
servlcos to students. 

Rather than create our own structure, we chose to dev.-lop an 
Instrument along the lines of the cr'lterla developed by McConnelld?) 

College Student Per sonnel Programs; appraisal and Develnp - 
ment. It should be noted that similar types of Instruments were 
developed over this same time at several different locations, all re- 
lating back to this document. We surveyed the administrators, faculty, 
student services staff, and, of course, the students. We asked 
them to assess the importance of various Student Personnel functions 
md Che performance of the institution In carrying out these functions. 
We did not limit ourselves to the crltp.rla identified by McConnell, 
but added a section to each' of the surveys trying to take a closer 
look at particular questions in our own institution especially the 
structure of counseling services and faculty advisors. What was in 
1972 a descriptive survey and in 1976 another descriptive survey 
has become a developmental research project. 

Case and K i e Id Meth od • This approach is one we occasionally use. I 
would classify our study of The Impact of the College on the Local 
Kconomjr(jo)as .i case .ipiiroach In that we did a rather intensive study 
of the Institution and Its relationship to the community. Studies like 
this one may ^Ive ycni gr.ater insight into the service area and the 
operation of vour Institution. 

^' .^.^''"'^' . ^A '^A"-!! '■'•'^ ^ ' We've all heard of the idea of trying to 

predict success In colleges by using correlation research or regression 



ERIC 



dnalysLs, At HACC, we have used this method ot* analysis as part of a 
two-ti)hl study ot Ai'counting lOI, First, we used correlation analyses 
and ti'Hivsslon analyses to study student charac terl st iv s , and then we 
used quasi-experimental techniques to study ln?« true t ional methods 
in accounting, The study of student characteristics in Accounting 101 
was prompted by the lact that a large percentage of students did 
not earn satlstactury grades (A, b, or C) . Knowledge of what factors 
contributed to success nr failure mi^^ht provide a basis for changes 
In such thlnj^s as sectioning, prerequisites, or guidance procedures, 
We were also looking for factors which might have a bearing on the 
design ot experiments on Instructional approaches, 

We surveyed Uil I enrollments in Accounting 101 in 1971 to gather 
data which could be used with the data we already had on file to run 
a regiesslon analvsls with student fii\al grade as the criterion vari- 
able. The variables wc used were sex » v e t e r an ' s ^s t a t us < high school 
c urr i culum , h school bookkeeping , high school accounting , hij j h 

r^'^-l^ ' A^-'/-'^^^ t In^^ 100 Pr^v^p^^J^^ ^nd Accounting 101 previpusl^ t 
_a book k eeping job , an A ceo u n 1 1 n g j ob , total credits , a^e , h ou rs 
• w o^rked dur in g the school terni , and each^ of the ACT scores (including 
the compost te) , 

The analvsls oL all full-time students resulted in a maximum 
multiple K ot 0,53, which means the variables could account for 
2S percent the variance In final grades^ The ACT composi te score 
was tlie tirst variable to he entered and had the highest correlation 
(,*!/!). with t iHci l^ ^'^.^^^.^^ > ^-^"^terion variable, was the second 

variable enteri'd and had a similar correlation with final grade, 
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The point is we can tease out these variables which may have some 
impact on success of the individual student. 

The standard error of estimate of a predicted grade was 
approximately 1.15. In the equations we used to predict final 
grade, the chances were 2 to 3 that the actual grade would be 
within a range of + or - 1.15 of the predicted grade. None of 
the analyses yield equations that would be very accurate in 
predicting final grade. Counselors may use the information on 
relative importation of variables in helping to plan a student's 
program. Of course, the data would be most useful when extreme 
scores are predicted. In this case, the counselor might advise 
a student not to take Accounting 101, at least at that time. 

The variables with high correlations with success were taken 
into consideration in subsequent comparisons of instructional 
methods. For example,, an experimental section with an Inordinate 
number of veterans and/or students who have studied high school 
bookkeeping would stack the experiment in favor of the experi- 
mental method. 

In short, the correlation research methods can be useful in 
teasing out variables and identifying those extreme cases which 
could be predicted with some degree of assuredness. There are, 
however, real limitations to this approach, including the fact 
that it does not necessarily identify casual- relationships and 
it is far less rigorous than the experimental approach because 
it exercises less control over independent variables. Then, 
too, it encourages a "shot-gun approach" to research whose 
results are often meaningless. 
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post^i.u'ln iistMri'li ^ an i Strouj', approach^ even though it it not 
« true cspttr iiMntal Method in that affficti arc Mnipuiated. The pur- 
post\ as wi» pniiii.a .Mit , is to investigate possible causa-and-af fact 
tolatloiiship.. by Observing sotf^e existing consequencat and saarching 

back through the data for plausible causal factors. This is in 
contrast to the experimental method, which collects its data under 
controlled conditions in the present. A good example of ex-post- 
facto research is the application of the multivariate analysis of 
variance oriented research strategy (MANOVA) toward understanding 
educational/vocational devt^lopment . 

The MANOVA strategy involved use of multivariate analysis of 
variance, dlscr Iralnant analysis and classification in multivariate 

or dls( rliniriaiu .-^paco, i\u>U-. and Lolnu\s('r) have pioneered tliese 
prncH'duri's an<l iiave d^ ve lopi'it Llie computer pro>»ranis to carry out 
tills nR'tliod, A rxaniplr ct this approach Is tound in I' rodi c t tn^^, 

t h t >^ j H' vt\i ; M H ( M ^ V I M ill >^ '•^^ ^ J- CuoJey and I.ohnes(f)), 

At our institution wo havo yet to do extensive studies but have 
tourid our initial rt'suUs rathor intorost inj^. Sul^stantlal Uifter- 
t»ncus iu tho various aptitudes amou^ >\raduatcs of various curricnia 
hrconie' qu i t*' appat'i'iU, iho :*.m' thodu I o>^,v viilds insight into the nature 
oi thi' .-;tiidfnt bodv and tiieii* interaction with currLcuia. 
^J}r\^\ Jv^iVTJJ^l^Vl^'Vl .""l^'^ JVl^ ^ * A'lth this approacli, we investigate possible 
i\mse-and-e t } t r*c 1 at i iMish ips I'V exposing one« or more experimental 
>;roups to one ot more treatment conditians and comparing tiie results 
with one or more tontri)! vU'oups not receiving treatment. Most ot us 



who have liad courses in statistics and design are well aware of 
til is mt^thod. We aiso recog- ze that it is almost impossible to use 
in most of the research we conduct at our institution, In light of 
the tact that it is aimost impossible to come up with random assign- 
ment o\ students to. sect ions , we may move to the quasi-experimental 
rese«ircli. 

^^^<A^^■'^J_'AL l^' r 1 men t a I N e c hod : Here we t rv to approximate the conditions 
oi the true experiment in a setting which does not allow tlie control 
and/or manipulation ot ail relevant variables. The researcher must 
clear Iv understand what compromises exist in the internal and ex- 
ternal validity ol his design and proceed with these limitations. 
An example ot this would he trying to compare the effects of treat- 
ments in col lege classes without being able to assign students to 
treatment at random. 

The second part of our study of Accounting 101 dealt with in- 
structional methods and was essentially a quasi-experimental design. 
We tried to overcome the iack of random assignment of students to 
methods (1) hv using identical and/or adjacent ' time periods on the 
same dav , (2) bv performing one way analysis of variance (ANOVA) 
with each of the ACT test scores, and (3) by reviewing the groups on 
the variables identified as having a high correlation with success 
in the course from our stiidv of student characteristics. We satisfied 
vMirselves Lliat none n\ the experimental sections were loaded in favor 
ui success on t lie criterion variable. We then proceeded to do 2-by-2 
ANDVAs liavln^', assigned eacii instructor botii methods nf instruction, 
one hcluK, the traditional approach to Accounting 101 and the second ' 
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belUK a muUt-medla approach to Accounting lOl, Results of this study 
showed tluit, overall, there was no significant difference In per- 
torniancu ot students under either mcttiod. 

Kven when there suctt a lack of significance, however, one 
still hafi learned quite a bit. The point here is that the multi-media 
approach is an (equally viable method of instruction, and the results 
of questionnaires ^Iven to the students shewed that a great many pre- 
fer this method ot instruction. Of course, tliere are such things 
as the Hawthorne effect, and this procedure would have to be replicated 
over quite a period of time to see if the attitudes held up, 
"Action" Research Method; Selgas and Shaffer's Chamber of Com- 
merce Conmiunltv-wldc- Survey(I9) was the first step in improving the 
relations between the Chamber ot Commerce of the Greater Harrisburg 
Area and harrisburg Area Community College, In terms of design, 
this prjO|ect lackeil rJgor In that we carried out a newspaper survey 

i 

with ajil the •prnl)Iems of nonresponse bias. We did make an attempt 
to control for dllferentlal response rates for various subgroups In 
tiie pote!it(al survey population. By doing this, we found considerable 
agreement among most of the constituencies. But even with over 1500 
responses 1 rom the general pul^ic, we were still left with a response 
i>ias. 

A^JKjna 1 y.(^H iment 

These .ire the general, researc.n metliods In a community college setting, 

1 

This overview w.is Inti^nded to bring Individuals who are new to the 
tielil ot Inst 1 1 Hi ioUiil research in contact with some experiences of an 
individual who h IS been in th»' f i e Id t i ve years • 
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It is worth not.lni^ that our erampiew have not Includv^.d any involv 
LuK tht* Inusiness operati(*n i>t the collt»fttv, nils sUuatlon u\\ou\d 
cUhw^v as tlif husinossi ufiici.* and M< oil ice a^'c to-- M»d to work to- 
Ktithtir developing manaK"UUMU iiitornuulon systems (MJ .;. I assume 
that vLrtviallv all IK pt>opif will eventually b.-cnnie hwolveJ In the 
development and maintenance ot the inytitution' s MIS. A:*tl;ew and 
Molr*s(2) text on the use of int'ormation Is an easy Intro-'.]', tion to 
this tleLd. Next, vou should review the piiblication of the N'^r:iot:ai 
Center for Higlier Education ManaRcment Systems (NCHEMIS) at Ihi* 
Western Interstate Commission for Hly;her Education (WICHE) . Wb.ether 
vou use the WIilHFVNQlEMS MIS in total or partially, the materlaia ^ 
.ire valual)le In terms of your own understanding of MISs. Much of 
the future ot. IK lies In this arena, 

Tlie path of IR offices at community colleges have been diffi- 
cult at times. I am, however, more optimistic than ever that IR has 
a place at community colleges and will make a far greater contribu- 
tion than ever before, 
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SWUNG, DATA COLLECTION, AND DATA PROCESSING 



Tlmothv LlKhtfleld ' 
Dean 

I'lannlng, Management, and Inforaatlon Services 
Moruer (!ounty Community College 
Trenton, Nt»w Jersey 



Perhaps I should begin this paper by indicating what it is not, It is 
not A paper that rarefullv delineates the ways and means of samp- 
. ling,, lectures on research methodolgy, or attempts to provide a mini- 
course on data processing, Although the institutional researcher must 
have a complement of skills in these three areas, he or she does not 
have to be an expert in them to be effective. There are individuals 
with far greater expertise than anyone at this conference who can 
teach us all the skills, pitfalls, and theory of sampling and data 
collection and processing, who would nevertheless be poor Institu- 
tional researchers. 

It is important for the researcher to resist any temptation to 
become an administrative accountant of data that is collected and 
processed, This is why he must develop management skills and an 
understanding of higher education and business. The researclier 
must have tremendous analytical capabilities. These abilities must, 
I feel, far exceed any proficiencies In statistics, data process- 
ing, or research methodolgy. 

What I would like to do in this paper is describe the ap- 
proaches used bv the lU ficu ot 1 ns t i tut ionaJ Research of Mercer 
County Communllv College, Irenton, New Jersey, ior sampling, data 



collection, and data processing, Aa an example, I will use our 
Student Follow-Up ?i'(>gram Cor graduated and nonreturning students. 

Sampling 

Sampling let the process of identifying a universe or population of 
concern and selecting from that population the subset or sets to be 
studied. Sometimes, however, the population of concern and the popula- 
tion we actually know and study differ because of sampling problems 
and response rates. This is particularly true in the study of former 
.students. Because of address problems or inactive individuals, the 
population of Interest becomes narrowed to what we actually can iden- 
tify or to those who actually respond, 

A question usually raised is whether to study the entire popula- 
tion or focus upon a sample. Usually in determining samples, there is 
some compromise reached between' the need for accuracy and the need 
for economy. At Mercer, we !«ave chosen tc survey an entire population 
(or at least the known population) rather than an identified sample. 
This decision was made partly because each year the graduating clas*? 
and the nonreturnlng student population are not prohibitively large. 
In addition, the objectives ol the Student Follow-Up Program made it 
necessary to communicate with every such former student. To date, 
this means a survey ot approximately 300 nonreturnlng students each 
semester and a survey of 500-600 graduates each summer, 

Thjrc may come a time, however, when the size of these popula- 
tions Is suv'h that 'lainpHiig will be necessary. Studies wc have done 
ot t'urollcd students (part-time students in the fall of 1973 and 
full-time students In the spring of 1973) have included a sampling. 
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In thoHO i'asi»s, tl.o populations co!isl»«tO(J ot several thousand students, 
and \iv didn't t la- 1 Lt was nt»cessary to roimiuni 1 rati* with i^arli individual. 

Thi* hasU' dLs.thu tLv)n In sain[)lliV^ theory, otv course, la between 
a proliahllltv aiul a nonprohab L 1 i ty sauiplis Generally, if we' want the 
t hiding's to hf truLv representative ot tlie entire population, we are 
ohliv;ated to take a p rol^),.ib il I ty s.iniple, It, on the other hand, our 
Intent Is to obtain '^ome sense or lee ling of the particuiar popula- 



tli>n, the luniprobabi I Uy sample Is preferred. In addition, lor reasons 



mav n*ed to l)e taken. The key, however, is to be sure there is no 
assMmptlt>n that nonprobabl L i ty samplius is representative • ol the 
eut Lre populat Ion. It must not be stated or implied. In fact, it is 
best, to cU»arlv state that the findings and interpretations are con- 
strained to the Ulentitled respondents and only to those respondents, 
There is no need lor the researcher to apologize for a study that is 
deserlptlve ol a particular group rather than an entire population. 

At Merv-er, we luive used both nonprobabl I ity and probability samp- 
ling tor ont» studv or anoth^T. 

^lUUVl^?i^il^lLUiXii:^i!irJii!ji' ^^^^^ accidenta l sample , the researcher 

hapha/ardlv rea.dies out and uses the available cases. At Mercer, we 

f 

luive I'hosiMi a elassroom i\t' students at a particular hour and admin- 
istered a survey to them. On the other hiind, in the quota sample , 
ti^e researcher wants to obtain some sort of distribution or quota 
of the various population elements beyond what is immediately avail- 
able. Finally, lor the pu r pos i v e^ sam p le , it is assumed that with 
good Judgment and appropriate strategy one can hand pick the cases 



ol convenlon.-e and economy, the risk ol using a nonprobability sample 





to be hicluaeci. We Identified such a sample at Mercer by picking 
out students In the Student Union who mt the selected population 
requirement! • 

Probability Sam f I jnj^ ; The key to probability, sampling, of course , 
Is the accurate, total, and unriiup Heated list of population members. 
Without, such a list, It Is not possible for the researcher to guarantee 
that all population elements have the same probability of being 
Included in the sample. With the list, the researcher can employ a 
slni pl e random sample utilizing' a table of random numbers, or 
he can use a s ystematic sample , taking every "ith" individual, after 
starting with some randomly selected cases among the first "i'Mndl- 
vJ duals, until, the required size i^ reached. 

Frequently, the researcher can utilize ■ stratified samplinj^ as 
a refinement of the simple random sample and can reduce the number 
of cases required to achieve a given degree of accuracy* When 
Mercer uses th Is . approach to measure students within programs, the 
actual populathm lists are separately compiled, 

The size of the particular sample depends, of course, upon the 
power h»ve! of the survey. c;ood representation with a small sample is 
bettor than poor representation with a large sample. It would also 
hold true that >;ood representation with a samplfi is better than poor 
^ representation with a population. An 80 percent Response rate for a 
sample Is more satisfactory statistically than a 20 percent response 
from a population, 

The sl/.e of a sample also depends upon the degree of hetero- 
geneity of the population. If the phenomenon to Le studied is 



rt'latlvely homogeneous, a small sample Is sufficient, On the other 
t)ilnd, the l^^^' variability of the phonvimenon is, the more 

cinrUHilt U Is to obtain an adequate sample, Th size, then, 
becomes dependent upon the nature of the population, the type 
of sampling; d<'si^ned, a!\d the degree of precision or accuracy that 
is desired, ^ 

There ma^' be times when the researcher must attend to^nonre- 
spondent bias In the study. Here again, pressure for economy and 
eftlclency may be balani'ed against demands foi total response o.f the 
population or sample. It there is reason to believe that respondents 
are uncharacteristic of the survey group, then there should be some 
nonrespondunt study. Moreover, if there is reason to account for 
each member of the survey group, then there should also be some non- 
respoiulent studv, fhe researcher might statistically compare re- 
sponses of tlif survey group with different waves or develop some 
techul<|ue tor inrjulrv once all administrations of the instrument 
fiave been completed, 

^'p^^yy t lon and Tro cos sing 
'Hu' collection . processing of data, of course, are very much re- 
lated to tht sampling. Because Mercer surveys the entire pop.ulatlon 
of former students in the Student Fol low-Up Program, we must devise 
an Instrument that facilitates data processing, Unless the items 
are relatively standard! zed, it becomes a monumen t al t ask. to tabu— 
late the datti and do the necessary analysis. 

Because of MercerVs desire to communicate with every graduated 
student, the sur\ey ol the entire population is ,oons idered necessary. 
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In onl.M- to,;uP.vy this ..niltv popiUatlcm ratfuT Llian .1. selected 
''•""!''*'• " II'" '■^^.iry c.. d.'si^ti .1 relatively s t rui- 1 urt'<.l art'd 
St .iii.l.ir.ll.Mvl I, ,1111. Mill- surv.'s Mnii .•nnsUiLs ol tour pact's of prt- 
>loniliiaiu Iv e-jPSL-.iuifd ,ind ,il tiTiuit Ivu rusponsi. Ufius and an open- 
.•luh'd s,i„aii.iry Li.Ti. I\. ust- .i quest iunnai re of this kind, wf attempt 
It. keop il„. I, Mm short ,md simple, make an lionest and attractive 
api.eal t,.i- i-e-,|.,,u.lent .-.Mperathm, and employ extensive follow-up 

•I 

ma ( J ln>; wdvfs , 

Kvfii though Pur d.iL.i colLucliDn must be standardized and 
s'Liurturfd. wi- aiv still jl, lo lo provide for Item flGxibility. As an 
.idd.Midum to ttu' ii'ur-p.i>'f siirvt'v form, we have developed what is 
.alW'd "Hk- SuppK^nentarv Ulmiis" — itoiiis prepared voluntarily by Inter- 
t'Mrd 'h'pn-tmPMfs or a.adt^mic units. These Items are open ended and 
M' leLifed .pecli ieal Iv to a particular program cr department. 
I'he t.Mir. l.H.selv Inserted in the graduating student's form. Once 
ir f . idiMni .teiLsl, ve nake no attempt to tabulate or. analyze the 
i prv>vided. !1ie respcnises for each sulipopui at ion ' 
.I-rlv -atlp rod .i').r'su!^mlttP(l to the appropriate department or 
)i ],!. \lt^;Mi^}i Ui.'se it.riis create an additional burden lor 
fhe ''e^, nr' vhi-:i v.ust i»rneess and uhnlnlster the form, 

|.hov do moot a verv special need of the departments and add fiexl- 
bi M t V to tlie survey torm, 



*\lth.»\i>;h rhi' Supp h-men t arv Items Increase the time required for the 
resi^<nidt»r\t • to oi^mpleLe the survey iorm, this does* not appear to 
al loot the return rate. I'or graduates ot programs wltliout tlie Sup- 
ple!..entarv Items, the retani rete Is approximately tlie same as ior 
thoso pri^gram.; that Include the optional Items. 
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i\h Indicated earlier, nne problem In surveying former st.udents 
Is tlu' (IhlicuUv ..I ktepinv; up-to-date addresses, I'o assist In longi- 
tudinal tolInw~up eirorcs, then, we Include an item in thu. survey I'orm 
asking the respondent to provide the name and address of someone who 
would know that Individual's address in tho future, liy retaining this 
Inlormatiop In a student-history tile, we can maintain contact with 
with the graduate atter the one-year toliow-up, 

l.ong-i'e r ni I'se 

It is particularly important for the researcher to develop a form that 
reflects the ohlcctives ot the study so th.it it is a valid and relia- 
ble instrument. I'retestlng the instrument on a nonprobability sample 
has prt>ved eftectlve in irpnin^', out unanticipated problems. More- 
over, the survey torm can and should be useful for many years. Thus, 
the effort put into developing an effective instrument ultimately saves 
time. MtH'eover, utilising tiie s^ime instrument, or at least a majority 
of tiie same items, tor several years facilitates longitudinal compari- 
son ot populations. 

In developing the instrument, it is important for the researcher 
to know not onlv when and why intormation is needed but also what in- 
formation Is neoded and for whom it is intended. The objectives of 
tlie study should be carefully deUneaVed prior to any instrumenta- 
tion. The purpose ol the Student rollow~Up l*rogram is to collect in- 
tormation [ ro\\\ the college's former students to assist in evaluating 
tlie o t t ect i veness ot the educational programs and services. Another 
purpose i% to provide the intormation on a regular basts primarily 
ovvr a h.nig I t ud 1 Uii 1 reterence. Specific purposes are listed below: 

5/ 
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I, To collect InformaLion about former students concerning 
their bioKraphic' and educational characteristics and plans 

J, To determine the present and accomplished activities of 
former students 

i, To collect Informat^ion from former students about their ex- 
periences at Mercer and their assessments of the programs 
and services 

^* To determine the decree of sntlsfnrtion of former students 
with their emp 1 oyment /educat iona I situation 

■ 5. To provide requisite data for completion of HEGiS and other 
external reports 

6, To communicate to former students Mercer's interest in 

their personal objectives and the college's availability for 
possible future assistance 

Data from the existing history files and tlie survey is collected 
tor both the nonreturning and graduated students of Mercer. Indica- 
tors are developed to measure, tlirougli the Student Follow-Up Program, 
the attainment of certain selected college goals and objectives. Bio- 
graphical informati »n ollected througli tlie surveys is eventually 
stored on a history file where it becomes part of the student's 
rero.rd, 

Syst emat i in^ and regularizing tlie on-going follow-up of stu- 
dents can produce extremely beneficial results. If such a program is 
ri'ptMted e«ich vear, codification of procedures becomes necessary. 
Allhoiigli, such atttMUion to detail and thoroughness in the instrument 
LJtlon and development of procedures requires considerable commit- 
meiu Co the project in the initial year, the long-term benefits are 
ooim i di'r.ih 1 e , 

At Meri'or, we have developed a 1 AO-page Ma nual of Procedures , 
which cvwers the nonreturning and graduating student surveys. We feel 




very' strongly ttiat caretul delineation and codification of the data 
collection and data processing procedures facilitates the conduct of 
the entire program; 

Advanta^eB of tiie Prog ram 

The primary advantages of the MCCC Student Follow-Up Program are 
descrihed in the Manua l of Procedures » These advantages include: the 
capabllUy for producing the survey findings (output) for whole popu- 
lations as well as identified sub} )ups; the means for identifying 
indicators of goal attainment that feed into the survey form; the 
longitudinal nature of the system; and tlie availability of a sur- 
vey form that produces data that is consistent for entire populations 
but is flexllUe enough to allow open-ended items foi; particular 
groups. These advantages bear upon the entire survey effort, from 
admtnstorliig the form, to coding and keypunching the data, and 
analyzing data and preparing the final report. 

Of particular note in this survey effort is our attempt to re- 
late college goals to identified outcomes. To provide a base upon 
wlilch to measure attainment of certain goals through the survey of 
forme' students, spedtlc Indicators were developed as the frame- 
work tor the Student ]miIUiw-1'p Proj;ram. ncnerally, these indicators 
tail into three outcomes categories, wtitch are found within most com- 
prehensive community colleges: 

(.i) Student occupational career development 

(h) Student educatliMial career development 

(c^ Student educatiinial satisfaction 
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with these aeUaed indicators, the survey fonns were' developed 
to obtain data tor jppJlcatlon to these indicators. FiRure A on page 
61. show^ t';e proues. by which data are obtained through the survey 
instrument and channeled to the appropriate indicators for assess- 
ment of goal attainment (student outcomes measurement). Thf College- 
Wide Objectives (Step 1) provide the input from which the Indicators 
of Coal Attainment are' operationallr.ed. These indicators (Step 2) 
then provide input into the design of the survey instrument or the 
Survev Itms. The data subsequently obtained from the Survey Items 
(Step J) provide the output; by which agreement with the Indicators 
can bo Judged, and, finally, agreement with tne Indicators (Step 4) 
suggests attainment of the goals. 

To facilitate the processing of survey information, a Fortran 
Jomputer proKram was developed to tabulate, cross-reference, and 
print u,.t the data on MCCC's computer. The data cards can be 
punc-h-jd directly t rom the survey form after some prescribed coding. 
Our hope Is that a delicate balance has been reached Li the creation 
ot a torn, that not only facilitates data processing bu is also 
ctmduclve to Htudent response. 

The output o. this MCCC Tabulation Program was designed to 
print out thi^ Individual items, alternative responses, actual re- 
sponses (including percentage distributions) subtotal of, responses 
U. each item, and subtotal of . ^response to each item. The pro- 
gram is designed so tiiat the response total for a particular item- 
tor example, number presently working full time—becomes the ha-.e 
numh«T tcr subsiH|uent and related items. 
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Ki>;iiri' A, Vssessmeut ot i\oii\ Attainment through the 
Survey of Graduated Students 

TIk' MCiX' Tabulation rrograni provides tabulations and percent- 
age d Lstr UjuL ions tor the entire population ot graduated student re- 
spondents as we L L as designated subgroups, Tlius, tlie printed output 
ran be olitalned tor as manv desiy^nated subgroups as desired. 
Various aihi^roups can be Identified by certain biographical'/educa- 
tional var- tables (^r bv cross-rei erence of responses to items within 
i\v* survt'v I iM-ni i Lse 1 1 • The output from the MCCC Tabulation Program 
is designed Lo be utilized directly in t!ie subsequent research report. 

In addition to developing systems and procedures for on-going 
and spi'clal studies, institutional researchers must be involved in 
data colleetion in yet another way. The researcher is increasingly re- 
quired to take the role of strategist for information gathering and pro- 
cessing. He or she must be preoccupied with data collection procedures 
and definitions so the data can be used for the requisite operational, 
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c:ot»trol, and pUnnlnR functions ol tlie college so the manage- 
m.-«nt intormatlon .systems that .ire developed Jo not become ends in 
themselves. The researcher must he involved in establishing logical ' 
data collection and processing systems that yield useful and meaning- 
lul Information and applications based upon reliable and consistent 
data. Hven though the evaluation of higher educatibn programs is de- 
pendent upon facts and statistical data, we must recognize t^e- impor- 
tance of the researcher whose informed and intuitive judgement 
qualify him co also take part In and enter the interpretation process. 

UeiH'flts of the Research Process 

one of Che effects of data collection is sometimes overlooked even ' 
though the benefits mav ajtually be greater than the actual re- 
search ttndings. The "process" of the research provid.cs 'a potentially 
.rowerfui stimulus for discuss ion and debate about the areas under 
consideration. The importance of the research study may lie as much 
In the provocation it cau.-ies as with the infonnation it eventually 
revi'als. 

The fruitless collection of data is pr. .,ably the most perturbing 
and humbling problem of the institutional researcher. If the purposes 
ot gathering thP Information ace clearly defined, however, meaningless 
data collection Is usually eliminated. Data simply remain da& until 
thev fulfill a purpose or specific objective and are put into a 
context that allows prudent judgements to be made. Even LC a 
sophisticated desl^^,n and extensive statistical methodology are de- * 
velr.ped, without sincere and thorough consideration of the purpose 
of the study, results may be more ambiguous than meaningful. 
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some'pWttcal considkratio^Js in aN/VLYZINg and 

LNTERPRETlNc; DATA 



. Arthur N, Cherdack 
^ ' Director 
Hilucatlonal Research and Analysis 
Los Angeles Community College District 
Los Angeles, California 

("ine ot tlu' functions oi a community college researcher is analyzing 
viuta .md iuLerp^ret ing tindings tor decision makers* This paper pre- 
sents several aspects of that task. It will be assumed that data is 
already available In some ^ormat — data that has been connected and 
treated by mc:ans ot statistical methods or other techniques; 

The To l it 1 cs oj' ')ata [nt e r ;>re tat ion 

As a practical consideration, it is important to understand what 
kii.J (iitormatlon your supervisor wants. It is possible, of course, 
ti> iiiterjH'et data in a number of ways. Books such as How to Lie 
Wit h Statist L^r s attest to the tact that a number of conflicting con- 
clusit.ns can be made about Identical data. Such comments as "this 
is wltat we are K^'^riK '^l^^ give me the data to support (ny plan" 
or "we do not want to present any data that would make a case for 
our opposition" arr samples of the kinds of Instructions researchers 
sometimes receive. The problem is that as a researclier you are taught 
to maintain ohlectlvity, but \ nr practical reasons you may feel 
that you should do what is asked o! you. Objective Interpretations 
mtiv be tniaccept-tibie. 
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ont. solution Is to convince your supcTvisor to allow you to 
analyze .lata as It sliouhi be analyzed reRardless ot wl.at is to be 
presented In a public report. An alternative solution, admittedly more 
dltllculi, Is to convince ve.ur supervisor to abandon any biased plan 
and allow the publication nt an objective report. 

I>^>J_.M . tju 1 1 a 1 1 1 ms 

When vou examln<6 data. It is important to understand some of the 
t.u-tors that may at tect vour interpretations. For example, if data 
Is obtained I com onlv one source, you should consider It.s rolia- 
billtv. Data reported by the Bureau of Education Statistics and the 
I'.S. Census Htueau would probably be more reliable than a casual 
campus poll that samples students who volunteered information about 
. the I r druK hab Its, 

Moreover, vou should check to ensure that the data is complete. 
Is there snmethinx mlsHlPR that mlKht affect your conclusions? For 
.•xample, lu report In^ on the number of students who transferred to a 
tour-vear university over the past five years, you should be sure 
there ..re no serious waps in your numerical data. If the numbers 
are tncomplete tor one vear, vou should report it that way and 
attempt to Uetermlne whether the missing Information may have in- 
lluenced vour analvsls. It Is also important to determine the cur- 
rencv ot voi.r Intormatfon. It you are drawing conclusions from an 
outdated source, th.-rc is a chance your Interpretations may be 
lncotr"cL. 

llnallv, trv to t Ind ..ther related data that will help confirm 
vour cone his Ions. In the case ot tr.-.nsfer students, if the same trend 
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uxLsLs In otlu»r ilisLricls and tlie inlerpn^Lat Ions tlioae dlntrlcts 
provide iirt' similar, Lhero Is a greater llkeliliood that you are on 
tar^4*t. Multiple sources oA con 1. 1 rmat Ion are always usefult 

II vou are to draw eoneUislons about data, it is necessary to 
revii»w the methods used In eollectin^ «ind analyzing Information. 
In eitluK a resuarcli study that uses a true experimental method, 
you should determine whether the proper procedures were followed — 
Ini-ludtn^ the use ol control >»roups — and whether the treatment really 
did make a dllterenfe, Dtten, studies are referenced even tapugh 
tiiey have heeii erlttciiied tor po. ^ experimental procedures and 
teelui Ujues , 

In survev researeii, you sliould ensure that the question- 
naires Lliat are used do not iiave major flaws. If sampling techniques 
were useil, che.i;k on tlie sampling procedures, Determine whether a 
hiaseil saiMpli» mly;lit iiave hwn utilized. Wa.^i the samplo large 
enougli/ Were random-sampling techniques employed? Was tlie sample 
representative »)t the populat.ion at large? There are books and 
<irt fries writti»n In' authors such as Campbell cind Stanley that can 
1)0 InvaluaMe In this ettort. 

II the results a pro^**'^"* evaluation Indicate tliat an In- 
st rurtioUii I pro>;r.im is working, review the entire evaluation plan, 
Cheek ti> seo It the program uses an oljj ect I ves-based approacli 
requiring mtMsurahli' dtita. This procedure makes It possible to 
determine whether the pn\gram ol)Jectlvc»s were really Miet, Seek answers 
iv the tollowln.g (|iu»st ion ; : Were data collected that lent support to 
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the fhullngs? were proper me. hods used la collecting the da^a? Was 
there any reason to suspect that bias existed or that the findings 
were slanted. 

lUsous^L n ■ ; tlio Imp Ucqt i.vns 

one ot the dl ft icuUle. involved In Interpreting data is that' it is 
usually not enough to discuss f .dings in their present context. You 
will probably be asked to discuss the implications of your inter- 
pretations and make some predictions about the future. For example. ' 
suppose vuuf college enrollments have been growing dramatically 
over LI.e past ten years. The question then is, "what wi.U happen next 
year or the year after, and how will It affect our operation?" This 
Is the tvpe or question that makes a fortune teller out of most of 
us. One recommendation Is to always anticipate this kind of question 
and be sure to prepare yourself to answer it. In the case of enroll- 
ment projections, you might need to develop some skills in projections 
me tliodol o^v , 

. 1.. evaluating Instructional programs, it may not be enough to 
sav that the program Is not achieving Its objectives. In conducting 

tormatlve evaluation, the decision maker will need to know what 
Hw.nges can bo made Lo Improve the future operations of the program. 

Iho mark ol a ,ood research unit Is its ability to examine past 
trends and present conditions and then make interpretations and pre- 
cllrtlnns about the tuU.re of the Institution and its operations. 
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T he Nee<.i tor Reconunenda t ions 

It in one thing to draw conclusions, present findings, and pack- 
age them in a neat bundle for use by decision makers. It is another 
to translate your Interpretations into recommendations for action. 
Tills is a procedure often neglected by researchers in community 
colleges, For example suppose a survey has shown that 90 percent of 
the students do not use the cafeteria food service? So what? Do you 
have any recommendations that might improve the utilization of the 
cafeteria? If not, whoever receives your report is likely to comment, 
"Nice to know, but who cares?" A more common response will be, "Give 
me some rtH*ommoiuia t Ions on what to do about it." The point is that 
rocommendat ions aro almost alwavs In order and usually help the decision 
maktT resolvo . ^roblom or mak'.» a decision. 

The C_a^e f o r S imp ll ci t v 

Know vour audience, If you are interpreting data for your college 
president or a board member the words you choose should be quite dif- 
ferent t rom those you would use for researchers. The president would 
pn^iably. not know or even care about the meaning of chi squares, 
levels o! s l>7,nl t Icance , and other research jargon. You will be more 
successful It you briefly summarize your report in clear concise 
t]ny;llsh «Hi o ne pa^e> Hoard members and presidents cannot be expected 
to read lengthy technical reports, Tf you must write one, it is use- 
lul to provide a brlel abstract at the beginning of the report or 
atlach a separate personal memo ttiat summarizes the contents* Above 
all, rememlu I to keep It short and simple* 

(VI 
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('cmcl ue^ Ion 

Communltv colLegt* researchers should obtain the skills and techniques 
required for analysing and Interpreting data. There are, however, 
a number ot pracLl.;al considerations usually not mentioned In textbooks. 
Tliese Include: (a) understanding the politics of interpreting and 
presenting data; (b) beLng aware of the limitations In your data; 
(c) reviewing the techniques and procedures used In the research • 
uesign; (J) discussing Implications; (e) providing recommendations; 
and (f) keeping reports simple and brief, 

It is onLv through experience and learning from mistakes that 
the ri searcher will come to know the reality of data analysis and 
Interpretation. I)ut it Is hoped Lliat tlils..,paper will provide some 
ins iw;ht , 
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DKVKUU'tNC /VNI) 1)1 SSKMI NAT INc; lU'.Si'/VRC.H KKPORTS 



Kohert (lull 

Mtiu tmune rv I uii I c:. r Co L U»y',i^ 
Kkuikvi 1 Lo , Marv Land 



1Jir^_2'uj-^u)sjL' oj^ lust itiit ioi ,il Kt' s a n-h^ Koj) o r t s 

I'lu* lust i t at ioiia 1 resea t l'Iu> i must always keep tu inliul that his/her 
re|uu't Is wiittiMi tnr a L'i>lU',;e .uim I n I s t ra tor , taculty nuMiiber, tliu 
pn'sUleiit, or a Lav hoard memher aiul nut tor another professional 
researc'lu'r. llu* reat.ler Is a [miSv person wiio has neither the time to 
read, nor interest in, exoiie research desl^.'jis and sophisticated 
statist liMl reutines. How Le report findings that the person who 
needs to use this in t o rniat ion is able to understand it with a mini- 
nium of ef tort, is the topic ot this paper. 

The primary purpose of Ins L i t uL i t)n.i 1 research Is to describe the 
institution quant Itat I ve Lv and qualitatively. The researcher must 
report on students, lacultv, credit hours, and dollars and must deter- 
mlui* the qualltv of the students, the f iculty, and the programs of 
the InstUutUni. It would be a w.iste ol time and money to spend a 
>;reat amount ol liard work securing; data about these things and then 
report tiuMn in surh a wav that the president tiei^ther understands them 
nor Is able to usi» thiMU in tlie adml n 1 s t raM on of the institution. 

An Institutional research ri»port is not a dissertation or a 



journal articli*. riu ri» Is no neiul 1 1) convince a committee of one's 
abillCv t.» di»:lw;n an experiment and write it up; certainly the 
pre»ii.dent Is net interested in one's al)llitv to write footnotes in 
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the prup.T form. I'robahW no ono at the Institution will ever repli- 
cate the study. Thev simply want to know wliat you found out and 
what yoa rt'rinuuK'rul . 

Par i:s o\ a tNt'jH^rt 

Most reports are dWided into hIx parts: I. statement of the 
probLem; J, luft liodn ! nx;v used; J. review of the literature; 4, re- 
port oi th(» tiadings; 5. conclusions; and 6. summary. Each of 
these is dlscui^sed below, 

A'JjL^^nien t > » r the p t^b I em : Tbe problem must be clearly stated so that 
tho reader can determine at a glance if the study deals with ques- 
tions that concern him or her at the moment. 

Methodoloj^v; The methodolgy of the study must be explained sim- 
ply enough jo that a lavman can understand what was done and which 
aspects of the problem were covered by the study. (A detailed explan- 
::M.on of '\o research design and the statistical techniques that 
were used would best be placed in the appendix.) 

Key lew of the 1 Uerature: Onlv studies directly related to the one 
beii^K reported ^hmiid be includ(*d in the review of the literature. 
Related r.ludies at similar Institutions will be valuable, since 
the reader wants to know haw the problem he or she is facing has been 
handled at other Institutions of equal size serving the same size 
o f const 1 1 iiencv . 

j^:T^l»X^^V^il^l-Jjj.)JJilil^ findings sliould be ;tated clearly so 

that ih.»re ran be no confusion about them. Ttie probability of an 
enlerliu: t reshman earning a degree or the proportion of the gradu- 
ates wiio Mud lelvi (n related tields are the kinds of statement.s 
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dtiaiis and prealdenLs Like to Lift out of an institutional research 
report, I'lu' tliuJla^ tliat a ditu»rence between two groups of students 
is not a matter ot elian^'e Is wfiat is important, not that an ,05 
Level or a.n ♦UL level ut signlllcance was found. 

Co ne 1 us inn s ; cone I us i on should follow from each finding of im- 
port. mee, and where appropriate, recommendations should be made, The 
researcher mav be as hold as he or she \;ishes and may expand on the 
llntlliiKJ^ as' this mav be the only opportunity to gain the attention 
of the adm I n Is t rat i o\\ , 

Suumuirv^: This part ol tlie report may be all the busy administrator 
ever reads. The re to re, it must be wrf:.::en carefully and accurately, 
Do not underestimate the importance of the summary, 

Tlie verv first pav;e or each institutional research report 
should be a one-page abstract, From this the reader will decide If 
the whole rep(»rt is worthwhile reading, Also ERLC will probably use 
It verbatim as the document abstract. Therefore, write this brief 
desci*lption caretullv, 

riie iippenilix is the place for all tliat which is too important to 
he left out but which has no pLace in the text. Copies of question- 
naires, rett»rence data tables, and statistical techniques which other 
researchers m^iv be interested in should be placed in tlie appendix, 
lUuMuse the report wILl he considered a reference within the college 
re>;ardlnv', the partictilar topic, it is wise to attach all relevant 
int (M'inat ion th.it tiLes will not have tt^ be searched a year or so 
later when sivnt^ t.icultv ci^nimittee or administrator finally gets 
.iround ti^ di'jlin>; -ith the topic, 
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Tlio !olU)wiii4 L.'um aru not tibsolutely vital Lu a report but may 
UMkf tho (It Mori'iu'f ht'twet-n wla'thur or not i t Ls ever read or taken 
sriiouslv. Tliev I'oiiu' I rom the author's experienci* In wrUin^ many 
reports, .some wliieli aj^pareiitU h.ul tittle or no value to the 
Iii.sL i tut ion, 

AlwMVH eo{bU(U-r h.'w llio Joeument will appear to someone who 
knows nothinK al^wut U. W^w Susv col le>;e ,admi nistrators have time to 

^^^'^^ P'l^'A-^ ■» reporl just to disoover what Lt*s 

about oi- ii it*, lUr on.- t»K'v\e been looking Tor, 

An .ittraotive ^y\\^y_ mav add notluuK t:o the cortont or impor-* 
tanoe .)! a report bul niav deunuine whether or nut a busy administra- 
tor notioos /nd re his it, V]w .-ost oi a:) eye-^eatch i ng cover is more 
than rep. lid bv t lie positive imay;e and impression created at tirst 
Klaiioc, 

A lojiort without a t ii lo pa^e showing what the report is 
about and wijo wrote it eldom .^ets noticed. Some researchers who teel 
a eoveriru^. memo adequa^^e''^ serves the purpose ot the title page do 
not realize that sueh memos are usually separated from the reports 
tbev doseribe. So be i-ertain your report has a clear and uncluttered 
t it le pa^^'. 

l.tMic, re[>orts, r-eports with more than two or three parts, 
sboulvl novo a t_alWj_ o:^ ooiUojUs .nid, II there arc several tables and 
M);uros ( lu- 1 nded, a list of t ah h\s and a list ot figures, 

'^'^ L'U/^^l*lL'-Ji\l\ ^''^^ provides b.iekground iniormation and assists 
(he rea^Ier to understand the context in which the report was written 



Im ht'lpiiil, Slu)rt rtfports do not ruiiulru separate Introductions; the 
opening' pnrav,r<i(4\ serves this same purpose. 

The remainder i>l tliis paper deals with the presentation of 'data 
in talMjlar lonn .iiul in the torm oi chtirts and graphs. The discussion 
ol rallies di.iws lu-avilv i rom a monograph written hv Helen M. Walker 
and Walter N, l)nrt>-.h tn l^Mu, whieh must be considered a classic in 
the desi>;n and use oi tabular presentations in research reports. 



T.ihles art' develi^peil ii^r two main purposes: (I) to enable the re- 
seareher to discover re 1 at lonsliips not clearly discernible in the 
une 1 ass 1 1 ieii data; and (J) to laciUtate the presentation of facts 
re>;<»rdin^ the topic under study. Thus, tables both analyse data and 
^unmn.lri/.e the results ni such analysts, 

Todav institutlon.il researchers otten determine the tables to 
be uset't beture the data are even seen, Thev do this by using statis- 
tic. il packa^^'s ^^uch as the Statistical Package for the Social 
Scienci»s (Sl'SS) ; K.iw reseaicli data fed into tlie computer come out in 
tabular lorm otten readv to he used in a report almost as Is, 

Tables mav he Lor ttie purpose oj' (1) presenting a comprehen- 
sive set (M data ov {>!) presenting a selected set of data in an 
aJ-ranK^'''i»'ut that brings sii;nificant relationships into perspective, 
lU»lny; a repositv^rv oi intormation, the general purpose table should 
i>c arran^^ed t vu* convenience in extracting Information, The age distri- 
bution • >! a ;t\ideni hodv lor example, would be from voungest to 
oldest. The ma t r 1 c M 1 a t I on-by- c \i r r I cul \!m table would list the 
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currLculuma in alphabetical order. A table showing where graduates 
transfer would be arranged geographically, 

in a special-purpose table which compares the size of Instruc- 
tluiial proKrams al a colle^.., the I (st of programs would he arranged 
acrording to ai^se so that the largest and smallest are obvious, If. 
fiu' example, in a study ot placement tests, the tests are arranged in 
the order of «ize of their reliability coefficients, either in an 
ascending or descending order, it will he obvious at a glance which 
tfsts arr the most and which are the leavSt reliable. Thus, 
slm-e tlie of the spoc la 1 -puri>ose table is clear analysis, 

ail atpltahel ical or geograph i .'a 1 order is usually no% desirable; 
it' is more expedient to arrange the items according to some 
meaningful scheme of classification, 

> 

The general -purpose table (see page 82) should be arranged so 
the user can quLcklv find the required information. Therefore, the 
data are arranged In a logical way such as alphabetical order* 

The majority of the tables used in institutional research re- 
ports are special-purpose tables, planned to facilitate analysis, 
Interpretation, and description rather than to present a tabulation 
of all-known tacts. Most tables are meant to show trends and tela- 
tlonshlns and contrasts rather than to furnish complete eaum6ration, 

. The researcher n-ast decide between (1) including the. facts 
being discussed as part of the text, (2) including the data in tabu- 
lar torm but without title or number and treating them as part of 
the text, md [ \) placing tliem In a lormal table with number and 
title, lo I lowing are examples of pach: ^ 

ERIC 



1. Textual treatment 

Of the 2,830 students matriculated in career curriculuma 
for the fall semester of 1975 > 34 percent were enrolled 
in Business and Commercial Technologyi 24 percent in 
Public Service Technologyi 21 percent in Allied Health 
Services I 11 percent in Data Processing, and 10 percent 
in Engineering Technology, 

2. Tabular form used as part of a sentence 

The average student credit hours (SCH) per full-time 
equivalent (FTE) faculty for all departments in each 
segment of the state's higher education system indicate 
decreasing SCH/FTE ratios as the course level increases 
at the university (1:59; 1:250; 1:77) and at the state 
colleges (1,320; 1:210; 1:170) • In an alternative manner, 
one can calculate the FTE faculty required to produce 
1,000 student credit hours using these ratios: 

Lower Division Upper Division Graduate 

Community 'Colleges 3,41 faculty 

State Colleges 3.13 faculty 4,76 faculty 5#88 faculty 

University 1.93 faculty 4.00 faculty 12.99 faculty 

While graduate instruction is relatively expensive in 
terms of faculty resources, the relatively inexpensive 
lower division instruction at the University may be due, 
at least in part, to the presence of graduate teaching 
assistants whose contractions would not be available with- 
out the existence of the graduate courses. 

3. Formal table 

Responses from the employment section of the questionnaire 
indicate that 73 percent of the respondents were employed. 
Of those who reported employment, over three-fourths were 
employed on a full-time basis as shown in Table 24. 

TABLE 24 



CURRENT EMPLOYMENT STATUS OF STUDENTS WHO ENTERED THE COLLEGE IN 
1970 AND 1971 AT THE TIME OF THE SURVEY 



Current Employment 


New Entrants 1971 


New Entrants 1970 


Status of Students 


Number 


Percent 


Number 


Percent 


Part-time 


963 


23% 


623 


22% 


Kul l-time 


3.155 


77% 


2,164 


78% 


Total 


4,118 


100% 


2,787 


100% 
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The researcher must decide when to use each o.f these three types 
of treatment. When the data are to be referred to more than once 
Ln a report and must be easily found, a tormal numbered fable should 
be used. However, when tacts depend for their mcaning^on the imme- 
diate context, when they must be read in context to be understood, 
and when t!iis context cannot be fully conveyed .in a table title, then 
these facts should not be displayed in a table but within the para- 
granh. (Keep In mind that a forma), table is movable and can be lifted 
from a^report without losing its meaning.) 

Tables tend to draw attention to data. Thus, the tabular form <^ 
may be used effectively to emphasize data which might otherwise get 
lost In uhc text. Long lists or large amounts of data can best be 
displayed In a table and placed on a separate page. 

A table is a logicallpresentation of data. For example, the 
title Is always at the top^of a table because a table is really a . 
list, and one tends to read down a list. The purpose of the title is 
to aid the reader In understanding the farts of the" table. There- 
tore the title should be an accurate and precise description of the 
contents of ttie table. All the information necessary for reading a 
table should appear with it so that the table can be lifted com- 
pli'tely out of the context and still be understood. The reader of 
the table wants to know (1) what it is a list of, (2) what or how 
many subjects the data describe, (3) what was the source of the 
data, (4) when were the data gathered, (5) what was the unit of 
measure, (b) how are the subjects classified, and (7) if percentages 
were used, what (s the base. At the same time, the title should be 



brlet* Moreover, U should not begin "Comparison of,.," or "Rela- 
tionship between,./' A title tells what is listed in the table, not 
what the author hopes the reader will do with the table. 

A s-^ries of related tables should have titles which indicate the 
similarity of the .subject matter as well as the essential diference 
from table to table. This may be accomplished in various wa^ ach 
as using dtffortMit sizes and faces uf type, bv using display titles 
with subtit\es ' th;it carry the more complete information, o^ by com- 
posing the titles In a way that emphasizes the differences. 

Tables should be numbered consecutively throughout the report. 
Any table necessc.ry to the report as a v^holn but not reu itea 
undei .tand the suhlect should be placod in the appendix. 

Roman numerals avoid confusion with page and figure nuttDeir,, 
However, if there are many tables, Roman numerals may be cuirbersome. 
A rule of thumb Is to use Roman numerals if there are no more than 
25 tables in a repo-t; otherwise use Arabic, In the body of the text, 
each table should be mentic ad by number, not as "the table above," 
or "the table following," or "the adjacent table." If the table is 
not mentioned in the sentence by number, one can place the number 
immediately following the sentence and enclose it in parentheses 
[(rablr n:)] , There is no need to say "(see Table II)." 

Every column in a table should have a heading referring to the 
subheadings or the tabulations of data directly under it. Likewise, 
every row of the table should have a heading. Ordinarily, the line 
or row heading does not name the entries but identifies them as be- 
Icnging to a particular class or group. 
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Headings in the stub or lett-hwd columns should refer only to 
.» if 
the. items ot those columns, not to the rows in which the other column 

headings HL«mu, if the column headings ar^ in a group that requires 
identification, place their title in a box above them. Make certain 
that the column headings or combinations of box headings and sub- 
headings name the data tabulated in the columns; these headings should 
name the entry and the class to which it belongs. All the subheadings 
under one box lieading should be parallel in structure. This is true 
for rows as well as columns. Otherwise, omiK the heading. In large 
tables, and especially on government forms, the columns and rows are 
often numbered to facilitate easy reference. 

Column headings are usually in the singular, and categories 
must be mutually exclusive, without any possibility o^' overlapping. 
At the same *ime, categories must be all-inclusive. That is, there 
must be a placo or every case, even categories such as "not given" 
or "no roHponso." 

There must be no conTusion regarding what is included in the 
total. Thus the title "total" Is not always appropriate. The ::erm 
"total" should be test-rved for those summaries obtained by the 
addition of all entries and may be placed at the top of the table 
rather than at. the bottom for emphaois. The total of the columns Is 
separated t rom the data in the columns by a double line so that the 
reader will clearly recognize it. 

A mixture of symbols, abbreviations, and words in the same 
table is not recor.imended. It is not good form to use a symbol for 
one group of data and a word for another ^n the same table. Keep in 



mluU that InacltutlonaL research reports are written for nonre- 
searchers and admlnlst rators who may not be familiar with Greek let- 
ters uHtni as statistical symbols and ott)er research shorthand. 

Decimal points should be vertically aligned In tlie columns and 
cam d out in the same number ot decimal places, Never carry a deci- 



mal out beyond a meanlngtul numhei;. of places, In insti tational 



re- 
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search, lew dlfte renews exLst which require more than two or three 
decimal places. Decimal fractions should be written as *'0,63" 
rather than ,63 to call attention to the decimal point. Use a comma 
In numbers of more than tliree digits for clarity. 

Tile' dollar sign Is placed before tlie first item in a column and 
bet ore the last, or total. Never use it as a column heading. On the 
other hand, when "percent" is used as a column heading, the percent 
svmbol (7n) ml^ht well be placed after eacli enftry, especially if the 
ci)lumn to the left Js composed of whole numbers. In yme cases, the 
relationship of the whole number to the percentage can be emphasized 
If brackets or parentheses are placed around it. In such instances 
the brackets are also Included in the column heading. 

The logljal structure of a table must stand out clearly. White 
space can often he used as effectively as lines. Whenever a tal/lc is 
clear without lines, It's best to leave tliem out, (-^^nerally, if a 
table h^*s no mc)re than three columns, tliere is usually no need for 
vertical lines. If a table crowds the page so that eye cannot easily 
select a figure, lines must he used. In a complex table, use lines to 
mark oft major divisions only, using only white space to separate the 
items within tlie major divisions. Horizontal lines should be used 
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only wluMi there Is a hreak in tlie structure to be emphasi/,ed, or a 
major suhc la ;s 1 1 i cat Ion > he set ol i\ A line with every row is con- 
tusing ana cuuU.slrahle, Whatever lines are useJ sliould fartiitate the 
read'-n^ ol the tahle. It two columns oL figures are to be compared, 
tlie lines should make It easy to tollow the two and Ignore the rest 
ot tlie table. Sometimes a reader Us mainly concerned with locating 
particular Items, and the table must h" so constructed that the entry 
in a .^iven coll can be readily tound. 

The dlspLiv ettect ol.' a well-made table ir.ay be spoiled by the 
unskLlKul use oi white .space or the lack of it, A table should be 
halani'ed mtich like a picture with an adequate margin. If a table 
won't tit on a page, perhaps two tables would he better. The use ol 
inexpensive graphic reduction equipment sucli as Xerox provides con- 
siderable tiexibilitv In placitg tables on the printed page. 

In summarv, keep In mind that the purpose of a tabJe is to provide 
a uselul summarv, not Just add up a column of figures. Keep in mind, 
too, who will be using it, A busy administrator may only flip through 
vour report t^nd look at the tables. If that reader cannot at a glance 
get tlie message vou arc trvliig to convey, the table has lost it:s use- 
fulness tuul has not made vour report stronger. Make certain your 
message Is clear, 

Ps I nj^ Cjiar 1 s^ ^an d ^^t apl i s 

'I'he response to a visual presentation will determine its value, 
As a maximum response is tl\e object Ivo, tlie d'jsign of a visual 
\or a non-technical audience sliould be ^;ulded by the funda- 
mental rule, Keep it s impie , >^ 



*Spear, Marv KlccUior, rr actlcal cliartinp techniques , New York: McGraw- 
Hill IJook Company, l^^O*/. 
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Insl I Cut lui\al ri'srarcliers should use visual presentations wlien- 
i'VtT tlii'V will r i l)ute U) clif L'omniunUMLlon oi ;in idea, A good 

Kraphit" prt st-ut at Loii lus only onr liUiTpretatlun, Use charts to 
altrcUL the attt'rulu') thi' r.>lLi>\e administrator or lav board 
memhiM- and von will v;et Vviur mussa^i* across It" the chart l.s not 
cluttered up with tmi much detail, 

Stime data Lend themselves to presentation hv chart or graph and 
othei*s tlo not. Likewise, tliere aru certain types of graphic presenta- 
tions which are approprUite only to certain types of data, It" one 
ItiMu, such as rail enrollment, is to te plotted for several years, 
a column chart would he best. On the other hand. If the enrollment 
trend IS to he I'mplMs I /ed , a line chart would be appropriate. The 
cxamplrs on p iv.i's s; t-i S<^.) illustrate wnvs In which charts can be used 
to tiulcklv convev a messa.^;i' whereas a table or narrative would be cum- 



Tnst Itnt lonal research reports cU'e not written for other re- 
sivirchcrs bnt ratlur tor hnsv c:l!'^* ^ ^H t ra to rs , trustees, faculty, and 
clt l/»Mis who Wvint to know more about a spo'^lflc aspect of the college, 
l)i.'rrtoro , ilu* repoi't sho\i id he written in :;tralghtforward language 
tree el reseaich iar);on, Intoniw^tion necr^ssarv for replication, hut 
not necessarv to the n!\d»'rstandln|,; ot the report, should be. relegated 
to the ap[»endlx. The president should be able to quote from the 
rep<M't In presentations to the trustees and the community, v^() 1 f --s t:udy 
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TABLE 11 

1975 GRADUATES OF MONTGOMERY COUNTY PUBLIC SCHOOLS 
ENROLLED AT MONTGOMERY COLLEGE FALL 1975 



HUh School 


1975 Graduates 


1975 Graduates 
EnroUad at MC 


P AIT/* ATl^ 


B«thc«d«~Chevy Chase 


582 


85 


15X 


Montgomery Bleir 


578 


90 


16Z 


Vinaton Churchill 


604 


111 


18Z 


Damaacua 


213 


38 


18Z 


Albert Klnatein 


414 


80 


• 19X 


Galtheraburg* 


593 


125 


21Z 


Walter Johnson 


541 


95 


18Z 


John F« Kennedy 


358 


65 


18Z 


Col* Zadok Magruder 


390 


106 


27X 


Richard Montgomery 


410 


88 


21Z 


Northwood 


515 


90 


17X 


Faint Branch 


277 


42 


15Z 


Robert E. Peary 


658 


164 


25Z 


Poolesvllle 


93 


17 


18Z 


Rockville 


254 


75 


3 OX 


Sherwood 


250 


43 


17X 


Springbrook 


624 


114 


18Z 


Wheaton* 


663 


153 


23Z 


Walt Whitman 


727 


80 


IIZ 


Thomas S. Woo ton 


361 


74- 


20Z 


Charles Woodward 




73 


20Z 


TOTAL 


9470 


1808 


19Z 



* Includes Kvrnlng High School 
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TABLE 17 



THE CREDIT HOURS EARNED BY STUDENTS 
AS OF THE BEGINNING OK THE FALL SEMESTER OF 1975 



HOURS 
KARNED 


DAY 


PER- 
CENT 


EVENING 


PER- 
CENT 


DAY/EVENINC 


CENT 


TOTAL 


PERCENT 
OF TOTAL 


0 houri 


■ 4274 


49X 


1695 


47X 


556 


35X 


6525 


47% 


1-12 


1410 


17: 


1055 . 


29% 


977 




2742 


20% 


rj-27 


1400 


lf>l 


459 


in 


328 


21% 


2187 


16% 




1053 


12% 


227 


67. 


111 


18% 


1557 


11% 




453 




121 


3% 


111 


7% 


685 


5% 




120 




64 


2% 


27 


1% 


211 


1% 


TOTAL 


8710 


loor 


3621 


100!?; 


1576 


100% 


13907 


100^ 



Thi. special purpose table is used to emphasize trends or relationships 
ami flarlfv dlflerence.- among Rroups within the total population. 

and accreditation committees should be able to find the answers to 
their questions quickly by referring to TR reports. 

Tables should present data either in such a way that specific 
facts can be found or so that information supporting an argument or 
Idea Is obvious. Likewise, graphs and charts should be simple and 
present an Idea clearly. The appropriate use of tables and graphics 
presentations In an institutional research report will facilitate the 
understanding of Ideas and add much to the report. Furthermore, an 
attractive cover and a title page which clearly identifies the 
report can he of great value. 

Finally, keep In mind that the purpose of the report is to accu- 
rat.'ly describe some aspects of the college, either in quantitative 
or qualitative terms, and not to demonstrate some exotic research. 
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Figure ¥ 



THE CLASS DESIGNATION OF STUDENTS 
ENROLLED DURING FALL 1975 




Fi>;iiro B 

TllK KiV'IAI. COMPOS ITTON OK MONTHOMEKY COI.l.KHK STUDENTS 




*Hxc'lusLve of other groups. 



A ohiirt or >;rciph should ho olear and easily understood* Only ono 
nu^ssa)';^ should lu» r oimnun i tMt od , and it should he ohvlous at a glance. 




INCRKASKS TN \X)\AAK ClIARCK PER CRKDTT HOUR AT 
MONTCDMKKY COI.LKCK SINCK FISCAL YKAR 1970 




TretulH ;itv tMsMv LlLustraued with a line ^rapli usln^ tJmo as the '*Y'' axis. 



When comparing auch data aa the enrollment by credit hour load for two aemeaterSi a bar graph such 
as the one below . clearly indicates where changes have occurred. 
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Credit Hour Load 




MONTGOMERY COLLKGE 
REVENUE BY SOURCE IN TERMS OF ACTUAL DOLLARS 
FISCAL YEAR 1970 TH".OUGH 1976 
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MONTGOMERY COLLEGE REVENUE BY SOURCE 
AS PKRCKNTACE OF TOTAL OPERATING BUDGET 
KISC'AL YKARS 1970 THROUGH 1976 
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MANAGKMENT: DEVELOPING ISSUES AND COMMUNITY COLLEGE RESEARCH 

Nolen ri. Ellison 
District Chancellor 
Cuyahoga Community College 
Cleveland, Ohio 



The Current Setting 

Community college adminiatratorg , like all persons interested in in- 
dividual institutions as we.1 1 as the general future of higher educa- 
tion in America, have witnessed significant new challenges emerging 
for these institutions. These challenges will undoubtedly ^Iter the 
short- and long-range fdture for community colleges. They have 
emerged as the result of internal as well as external forces that 
by their nature have altered the kind of leadership needed as well 
as ttie management and operational functions of our institutions. 

community colleges have made certain adjustments in response to 
miw conditions facing all of higher education. These adjustments 
were described during the sixties and early seventies as the demo- 
cratizing component of higher education in America because the 
open-door and low- or no-tuicion policies were among Uhe major 
changes ttiat took place. 

In addition, the rapid growth in higher education enrollment 
during Che period since 1960 (which resulted from several factors 
including federal aid tor student tuition, altemat;ive« other than 
the armed forces opening to 18-year-olds, and the post-World War II 
population group reaching the traditional college age) began to taper 
off dramatically, producing a state of slow or no growth for higher 
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education by mid 1970. This declining enrollment phenomenon is ex- 
pected to extend into the 19808, 

Furthermore, the rapid rate of inflation and related increases 
in wages and the cost of goods and services were experienced by all 
sectcru of the Awerican economy in the first half of 1970. During tnat 
period, higher education, was given lower priority by the state than 
before, particularly in relation to economic development and social 
services. The realities of a "smaller pie" to 5-)lit among the vari- 
ous public sectors has meant less for higher education. 

These major societal conditions, along with expanding expectations 
of those associated with higher education, the need in higher educa- 
tion institutions as well as state systems (such as boards of regents) 
for a method and process for managing decline — a concept foreign to 
higher education and its leadership. Reflecting on this new prospect, 
Kenneth Boulding(l) suggests that the "management of decline" is no 
easy task, and he states: 

Many (management) skills which were highly desirable 
and which were selected in the last thirty years may no 
longer be the skills which are needed in the next thirty... 
Yet we know so little about decline that we are not even 
sure what these needed skills are. 

Leaders in higher education knew one thing: They had to de- 
velop improved ways to plan, manage, and evaluate the utilization of 
the resources that were available to them. They also knew that ways 
had to be found to maintain certain institutional flexibilities 
through the reallocation of resources as well as traditional alloca- 
tion processes* Better definitions of institutional purpose, mission, 
and programs were needed. 




Ki'milsolU J) points cut that commimity college administrators 
appointed In the past few years are a new breed and that this new 
breed trequently applies systematic management techniques in the im- 
plementation ot board policies. It Is clear chat these new .leaders 
will not only play a critical role in assuring the survival of com- 
munity colleges as we know them but will also redefine institutional 
research to meet their leadership needs. 

in a recent commentary entitled More Than Survival (2). The Carnegie 

Foundation tor the Advancement of Teaching points out the problems 

currently being faced by higher education institutions as a rt jult 

of external and Internal conditions that have developed over the 

past fitteen years. Central to the Carnegie argument are: 

I. Ttie current decline In the enrollment growth patterns 
being experienced in American higher education, 

i. The Impact of inflation nationally and its differential 
etterts tn the public institutional sector—especially 
higher education, and 

3. The problem of flexibility or the lack thereof as higher 
educational Institutions attempt to make the necessary 
(and often survival) adjustirents for the future. 

tn addition to the factors cited by the Carnegie Foundation, 
higher education Institutions are faced with the American public's 
demand for increased accountability from all public institutions and 
agencies. Accompanying this external demand has been a new focus 
Internal iv on efficiency and effectiveness measures of institutional 
operations. Specltlc Implications for new and improved management of 
out- Instltiit ions will be discussed later. 

In addttUni to the Carnegie Foundation work, recent efforts of 
the National Commission on the Financing of I'ost-secondary Education 
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as well as the continuing work of the Carnegie Council on Policy 
Studies have made clear the fact that individual institutions are 
atle/ted by events at the national and state levels. Therefore, 
It is impossible for such institutions to plan in a vacuum, oblivi- 
ous of external constraints. Also, it is incumbent on national and 
state governments to ratiunalize their own planning systems in order 
to be more supportive of Individual institutions if such institutions 
are to maintain an acceptable level of quality beyond mere survival, 

U should be clear to all involved in higher education that at 
this point there are no panaceas — no simple solutions to the problems 
now facing the state systems and the individual institutions — and 
any proposals for simple solutions must be viewed with great caution. 
This rautlon is necessary because at this time there appears to be 
a rush ti>ward over-reliance on what appear to be easy technological 
answers to the Institutional problems, usually given catchy labels 
suih as HHM, PKRT, PPBES , IE\\ and the like. Theie are clear perils 
for management leadership of our institutions when such new scientific 
approaches to institutional management do not grow out of an insti- 
Lutlon-wide leadership philosophy that leads to a systematic, 
common-sense management improvement or development effort. 

The Carnegie commentary makes two recommendations that should be 
considered hy Inst it .tions seeking to respond in institutionally 
sound ways to the new conditions facing higher education, 

Tht' first recommendation is that institutional leaders prepare 
analyses of their institutions to determine, as accurately as 
possible, the present situation and the factors sliaping the future 
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(directions). These analyses should be used to inform nheir col- 
leagues and constituents, and should be part of a strategy designed 
to create receptive attitudes and conditions that are conducive to 
change, 

Tne second recotmnendatlon is that each institution, if it has 
not already doae so, develop an overall strategy for dcvelopiiig flex- 
ibility in the use of funds, assigning faculty, using space, and 
effective decision making. 

A thorough understanding of these recommendations and their 
implications for institutional management is fundamental to an un- 
derstanding of the challenges facing community colleges and other 
higher education institutions and the responses that are required ^ 
if they are to survive and prospe^r. 

Challenges to Management — Nov and in the Forseeable Future 
Specific issues now confronting institutional leaders as a result 
of changing conditions can be categorized as either of a primary or 
secondary nature. In addition, other challenges proceed from these two 
major categories. It is Important for institutional administrators — 
who are Involved In planning, research, or development to understand 
these challenges and their inherent cause-effect relationships. A 
lack ot understanding In this area will cause management, opera- 
tional, and/or development problems for the practitioner. 

Primary Issues confronting institutional management are: 
A. AccountabiUty — addressing the public demand for greater 
accountability In both operations and board policy matters. 
The need for increased efficiency and effectiveness of 
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operations is a related concern* Increased productivity is 
generally perceived as an fc:cpected outcome of efforts in 
thia area, 

B. Planning — the need for improved long-range planning with a 

written plan of advancement » which at least contains a mission 
"statement, a statement of institutional goals for educa- 
tional and educational support programs, a resource plan, 
and specific delegation of responsibility for implementa- 
tion (by function,' not person). An ongoing strategic planning 
system that ties the annual budget process to define institu- 
tional program goals is an essential outcome of improved in- 
stitutional planning. 

C; Managemen t — improved management of i.nsf'.tutional resources 
(human and fiscal) is the focal point of new demands facing 
institutions of higher learning. Applying new management- 
science techniques in higher education institutions will re- 
main a challenge to community college administrators in the 
immediate future. Such techniques as MBO, PPBES, MIS, and 
others must be approached with care as indicated earlier. 
Because the climate for institutional change 1^ critical to- 
the achievement of the actual change desired, the direct 
application of management-science techniques to an "unready 
institution'^ can have counterproductive consequences. In 
the current perioa ot heightened employee anxieties and 
tensions, care must be taken to assure that the improve- 
ment of quality in Institutional efforts is understood 
as the desirable goal being sought. 




n. Kvaluatton -Measurlng the results ot the efforts expended 
and the activities undertaken and establishing baselines for 
projoctlng the future are essential tor meeting the chal- 
lenges presented by demands for improved accountability, 
planning, and nianagemtnt. With the explosion of institu- 
tional Information and the coiicommltant need for infor- 
mation to support improvement planning, management, and 
evaluation, it is essential that community college admin- 
istrators identify leadership that is capable of producing 
good Information and analysis to facilitate sound planning, 
management, and evaluation systems. 
Tho role of Institutional research and its place within the or- 
Baui^atlon must be considered during the development of an improved 
planning, management and evaluation system. 

Once the primary challenges and issues confronting the institu- 
tion hav.' been Identified, a whole range of secondary challenges and 
ls.sues-tho.se having to do with the application of implementation of 
new planulns, management, and evaluation systems, as well as improved 
organizational arrangements— must be addressed. Each institution 
must design its own plan lor addressing the concerns it views as 
critical to its own survival. Because the conditions confronting 
higher education in each state and in each institution are often 
dttterent, unique listUutlonal responses are required. It is clear, 
however, that the primary challenges or issues confronting community 
colleges do not varv greatly. Fach of you here must help determine 
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the kinds ot respu. • that must be made to the new demands for 

Improved leaderslu :ianagement. 

if 
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An additional dimension, which stiould be focused on at this 
point, has to do witli the increasing demands on institutional opera- 
tions derlvluR from the external environment. Sound institutional 
et torts dOvsLgnod to Improve accountability, planning, managinent, 
and evaluation systems must be developed in light of the increasing 
demand^ of regional, static, and national agencies. Demands from 
these three external sources have had varying impacts on community 
colleges uationallv. The least difficulty has been experienced to 
date from regional configurations, although program planning and 
funding appears to be emerging as an Issue from this direction. 
This Is particularly true when high-cost occupational or vocational 
programs are approved and funded at the state level. The concern over 
nondup llcallon of hlgh-co^t occupational programs will increasingly 
link regional considerations to decision making. 

The demands for Increased coordinated planning and evaluation 
have come primarily ffom state agencies that have been delegated the 
responsibility for statewide planning and coordination of higher edu- 
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cation. Wliere community colleges are totally funded by the state, in- 
creasing tensions will become apparent as management issues are 
Increasingly iiigh L ighted . Faculty collective bargaining concerns 
will uiuioiibteuLy act as a catalyst in this area. 

The federal government's demands for information reporting and 
cumpllanci» wltli certain federal laws will continue to affect insti- 
ttitlonal operations. Tliese responsibilities to the federal government 
will be a continuing concern because they require the use of re- 
sources that could otherv^lse be used for internal planning and 
managerattit ot the institution. 

lo ■ 
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The implications of these external requirements must be takeu 
into account in projecting certain long-range aspects of institution.1 
management. Each institution must respond according to its unique 
state of development. 

A Place for InsH ^■ ltlonal Researrh ? 

So much for the constraints and challenges and new demands on community 
college administrators. My experience leads me to be cautiously op- 
timistic about the future of our institutions. The technological base 
and human talent are sufficient to meet the challenges, and higher 
education should emerge leaner and stronger from having been tested. 
Mont of you are undoubtedly interested in the place of institutional 
research in future battles for institutional survival-in the front 
ranks, in the rear, or nowhere at all? 

Past institutional research programs focused partially on pro- 
ducing longitudinal or evaluative studies (which were used basically 
in public relations/information efforts) and partially on manage- 
ment information development and reporting. These priorities will 
give way to new ones. As e. result of new demands on institutional 
management, institutional researchers, planners, and development 
officers must now assist in constructing new directions for insti- 
tutional research, which must emerge from the current chaos. 

Let me be frank in saying that I have no idea whether "institu- 
tional research" as such is a useful concept or function or organ- 
izing principle. Indeed, it might be far more useful if we aban- 
doned, at least for the time being, the term "institutional research" 
and, Instead, focused on the informational needs of institutions 
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chat must be met If they are to survive and flourish, "institutional 
research" can be Justified as a function only as it contributes to 
meeting these informational needs ef f<!Ctively , This is a critical 
point to understand because, in my opinion, the lack of responsiveness 
Co^institutional needs — the inf ormation-as-an-end-in-itself synarome 
— has kept the traditional Institutional research function in the 
backwater of new developments. How. many competently produced reports, 
of impressive size, have you read that proved "fascinating" or only 
'interesting" but certainly of no impact on institutional behavior? 

There is no question in my mind that information alone is 
neither good nor bad, but when it does not meet a well-defined need, 
it is at best wasteful to produce it and a waste of time to read it. 
The only way I know of to approach the "usefulness" question is first 
to define the general types of decisions that are made in your insti- 
tution and then identify the information needed to make the decisions 
intelligently,. Of course, it is not enough for decisions to be in- 
formed; they must also be timely. In today's world, too late can 
mean never. 

We know intuitively that institutions make decisions that are 
(1) strategic, (*!) executive, and (3) operational/managerial. And 
it is not very difficult to identify the various kinds of informa- 
tion that are needed at certain times to make decisions falling in 
each category. Moreover, this can be done with very little technical 
razzmatazz and double talk. It is a job, yes, but a very common- 
senaical one. 

To my knowledge, most progress has been made in operational 
lecision-making, especially in such obviously critical areas as 
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financial and budget management. We are only at the beginning in stra- 
tegic planning, which, most of you will .probably agree, relates most 
closely to what has been known as Institutional research. "Research" 
•suKKosts tho more In-dc-pth. IciK-term analysis on which strategic 
planning Is based. But. the point is that institutional research will 
prove relevant to long-range or strategic planning only in response 
to precisely defined Information requirements emerging from the de- 
tailed design of an institut lon'al strategic planning system and 
process. Again, it makes no sense to start with the information and 
then trv to figure how to use It. 

A final word on relevance: Let selectivity be your watchword! I 
share with mv colleague, Harold Enarson, President of Ohio State, 
dismay at the. fantastic volume of information uncritically generated 
for managers these davs. Can anyone doubt that our information-gen- 
erating capability has vastly exceeded our capability for analysis? 
I feel compelled to Join the rising chorus against a continued pre- 
occupation with the technology of information collection, storage, 
and reporting a„d to join the many other chief executive officers 
demanding less information of higher quality. 

Do not doubt that the survival of Institutional research as a 
fmu-tlon in some form will depend on its relevance as defined above. 
The pace has quickened, the challenges are substantially greater, 
and we at the helm of Institutions will no longer take the time to 
separate the wheat t rom the chaff ourselves. Either provide what we 
need when we need ft tor strategic and operational decision making, 
or tfnd yourselves oat of the game. 
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Cone I us ions 

The response ut community colleges to demands for accountability will 
be very Important In shaping their future,. Also, the attention given 
to improvement ot planning, management, and evaluation systems will 
undoubtedly play an important part in shaping the future of these 
Institutions, 

There are no easy answers or panaceas, however, for the prob- 
lems that have developed over the past few years. Planning for and 
management of decline are clearly the most difficult task confront- 
ing community leaders today. The skills required for these tasks 
have not been taught in graduate classes nor have most administrative 
loaders had the opportunity to develop the necessary skills on the 
Job, The frustrations and anxieties caused by the Imprecision of de- 
cision processes as well as increased demands for greater partici"- 
pat ion hv internal and external constitutents will present even 
greater challenges to institutional leadership in the future. 

The challenge to develop sound programs of institutional re- 
search is clear. The demand ton better, more precise information that 
will support the forecasting, analytical, and operating needs of 
institutions is increasingly apparent. What must now be determined 
in most institutions is- how to organize most effectively and effi- 
ciently to satisfy the .planning, managiement , and evaluation needs of 
the organization. The solution to this problem will more than likely 
rest upon the caliber and skills of individuals heading the insti- 
tutional research ot't ices rather than on a prescribed remedy of 
some kind or a single plan for institutional research in community 
col leges , 
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CONCEPTUALIZING CO«rJNm COLLEGE RESEARCH AT THE NATIONAL LEVEL 



John Lombard!* 
Staff Associate 
ERIC Clearinghouse for Junior Colleges 
University of California at Los Angeles 



Describing the ERIC Clearinghouse to institutional research direc- 
tors would be as fruitless as reciting the history of community col- 
leges to an AACJC meeting. Nearly all of you have been coritribu- 
tors to ERIC and users of its documents and quite a few of you have 
been authors of articles and monographs published or sponsored by 
ERIC. So you are aware, as Dr, Cohen(2) told a similar group about a 
year ago» that; 

lae Clearinghouse is a basic and continuing resource for the 
IR director, that the numerous studies that have been pre- 
pared by research officers provide an invaluable source 
for topics, designs, methodologies, strategies and the like, 
(and) that they show the range of what can be done. 



The Thru3t; Toward Non-Traditional Study 

As we review the current documents coming through the ERIC Cleari^^'^- 
house, we note a remarkable change in the philosophy of community 
colleges. So dramatic is this change that if continued, it will trans- 
form the community college to some new kind of institution to which 
the term college will not apply. The recent action of the City Col- 
legeji of Chicago in naming two additional institutes may be a step 
In this direction. The change in philosophy involves raising the non- 
credit activities, courses, and programs to the level of credit 



Mohn Lombardi represented Arthur Cohen, Director of the ERIC Clear- 
inghouse for Junior Colleges, who could not attend the confertsnce. 
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courses. Were U noL lor the premium on credlt-courre funding, the 
Hcale.s would by now be tipped In favor of the noncredlt courses. 

!-':rlnK the last five years, colleges have been reporting In 
their enrollment statistics participants In noncredlt classes and 
activities. i„ the current (1976) Community. Junior, and Technical 
College Di rector y, there ).s a new cv - m called "Community Education 
Enrollment". For October icj76, the community education enrollment for 
all ocUoges was more than one and one-third million compared with' 
a regular enrollment of approximately 4.1 million. Within the 
next five years, the noncredlt community education enrollment may 
very likely equal or exceed the credit-class enrollment. 

This phenomenon is arousing favorable Interest among administra- 
tors because It takes up the slack in the regular enrollment; It is 
raising questions among legislators because of Its effect on financing; 
and It Is being viewed with . concern among faculty because of Its 
effect on the nature of education. Although coll^ege and state 
reports contain many general references to It, information on this 
new category of enrollment, however, is still meager. 

Parallel to this development is the reordering of priorities 
among the various college functions. In their national study on humani- 
ties, Cohen and Rrawor( 5) observed that although community college^ 
boards, administrators and state-level planners see a plethora of 
roles tor community colleges, "the perpetuation and diffusion of the 
humanities occupies a priority status far below that of career edu- 
cation, remedial studies, adult basic education and student guidance." 
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The change In curri ulum tocus la also evident in the upsurge 
ot career education enrollment. In the 1950s, if 20 percent of all 
students on a campiu were in career programs, it was considered re- 
spectable. Today, anything lower than 40 percent is considered un- 
satisfactory. 

Outreach Pruj^rams 

These changes are part of the larger community-based, performance- 
oriented movement or of the thrust toward nontraditional study. On 
the organizational level, the movemi, c has resulted in large networks 
of outreach programs fanning out to the remotest parts of the college 
service areas. These networks, in turn, are combined to form non- 
campus colleges. Of the eight noncampus colleges now operating, two 
started as nonc^unpus colleges, and six were organized within multi- 
campus districts. At least another half dozen are in the planning 
stage. 

This development — the outreach programs and the noncampus 
colleges— has the potential for a tremendous amount of in-depth 
institutional research of a descriptive and evaluative nature. At 
present, there is only minimal 'information, mainly in official state- 
ments and accreditation reports. As a first step in this process, 
Roger Yarrington, vice president of the AACJC, and his associates . 
feel there ought to be a major, national, well-documented research 
description of the community collegoCA). 

While those developments are exhilarating to community college 
educators, there still remains the uneasy feeling that adding students, 
changing delivery systems, and taking ttie college to the students 



105 




ERJC 



are not the whole story. The nagging question of "How will are we 

doing?'* keeps popping up. Richard Hagemeyer (7) , President of Central 

Piedmont College (N.C.), said at the 1976 AACJC conference: 

Our colleges are trying to be adult and comnunlty-based and 
that Is a noble cause, but on that point we have trouble 
measuring effectiveness. Accountability breaks down In 
this area, not because it is less than desirable or be- 
cause it is not as educationally sound, but rather because 
we have not learned to package and price this product in so 
far as these non-traditional students and programs are 
concerned.... Our impact upon these diverse com- 
munity segments we attempt to serve mbst be mea- 
sured. 

In the spring 1976 College Board Review , Dorothy Knoell(lO) wrote: 

The strength of the community colleges has been their ability 
to respond to state and local needs for new programs relatively 
quickly and without tht infusion of new, special funds. Their 
weakness has been their inability to evaluate their success 
with successive groups of new students, except in l^rms of 
ever increasing enrollments of all types of students. Com- 
munity colleges need to propose new criteria for evaluating 
student performance where persistence and grades are inap- 
propriate, and to take steps to use new measures with the 
^ Increasing numbers of new students who enroll. 

Hagemeyer, Knoell, state legislators, and others are asking for 
new measures, new criteria, new definitions. 

The Role of the IR Director 

It is not for the IR Director to organize the new definitions. But 
he must be careful that his research designs fit the definitions that 
are created. One easy way of assessing community feelings about the 
new directions posed by off-campus programs is to apply one of 
the several goals inventories that have been developed in recent years. 
Drawing a proper sample of the district's population and adding what 
goals they think the college should be addressing can be helpful if 
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done on a contli^ulng basis. A one-shot or cross section of conuaunlty 
attitudes ts not much on which to base program planning, Put a set of 
data collected with the same instruments and sampling techniques over 
a period ot several years might be amazingly revealing. This type of 
information is important to collect because community college leaders 
continue to be astounded by the failure of their bond issues in the 
face of greatly augmented enrollments^ Taxpayers' support for the 
college is not necessarily a result of citizen participation in 
college-sponsored events. Any information that would help in deter- 
mining why this is so would be extremely useful. 

The movement toward nontradltional study or community-basedi 
performance-oriented education, as I have indicated, is leading 
to the formulation of a new definition of eduction that may free the 
colleges from the albatross of traditional educational accountability 
with its emphasis on grades and persistence. Obviously, grades, 
credits, and degrees are of little value to the elderly, to those 
who already have degrees or who do not need certif ication,,in its 
various forms. However, in substituting new criteria, the danger 
exists that they will intensify the handicaps of new students who need 
the trappings of grades, credits, and degrees. New criteria may be 
interpreted to mean that the new students "just don't have it and 
that they will have to be given something in order to have some- 
thlng"(h). 

A task that will challenge the ingenuity of researchers is to 
assess what effects the feelings of invisibility and isolation have 
on people who are associated with outreach programs and ' noncampus 
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colLesi's. President Smith(lS) of the Community College of Vermont 
noted that one i-.ommon teature of the noncampus colleges, "at once 
their greatest strength and liabllUy," is their "Invisibility with 
no physical tmage with whlcti anyone connected with the college can 
maintain htmselt personally and professionally." The Invisibility ex- 
tends to students and faculty who "emerge from and blend back into 
the community." Invisibility also leads to a feeling of isolation 
ou the part of Instructors and other employees. Moreover, the 
advantages nf flexibility, accountability, and responsiveness gained 
in giving up the physical structure and distinct culture of the 
campus are obtained by "the surrender of traditional reference points 
w.hlcli bind campuses together." 

fa one Wav or another, ttiose connected with noncampus colleges 
echo Smith's Impressions. The Los Angeles Commission on New Dimen- 
siiiusC)) called attention to fhe problems created by "the very nature 
of the new Institution," specifically: "The students would be even 
more transiynt tliau those of the other colleges. Dropping in and 
but would he even more pronounced. Many of the New Dimensions stu- 
dents would never see anything with which they would necessarily 
and specifically identity as a campus of their college." The admin- 
istrators of Coastline Community ColleRe(l3) believe that "A college 
without walls obviously cannot exists without some physical facili- 
t les — somettiing with wtiicli a student can identify." 

Invlslhlllty and Isolation are implicit in the first sentence of 
a hnn-hure(HJ admonishing ttie reader: "Don't plan to >-ake a walking 
tour'ol Lhe nicer Community College campus." The feeling of 
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Isolation L'auHed by noncainpua operations in many scattered locations 
with tew opportunities tor communication between and among --faculty 
and students, was one of the first impressions President Tapper (16) 
of the Peralta (lolLege for Non-Traditional Study received soon after 
her appointment. It is not surprising to find among her plans for 
the immediate tuture the development of institutional involvement/and 
commitment among bll personnel. 

William Ke(m{9), President of Pioneer Community College, wrote 
soon after becoming president: "I sometimes think that Pioneer is 
so far removed from the real world that I'm a lost soul from another 
planet and it is encouraging to hear Lrom the far corners of the 
Universe." A similar feeling of lack of ' understanding, particularly 
by the Board of Trustees, was voiced by the Executive Director of 
Che I.os Angeles Commission on New Dimensions , 

The IR Director is going to have to study ;:he various aspects 
ot off-campus and non-campus programs: Do the participants feel ne- 
glected or isola'^ed? What is the effect of the lack of accessibility 
of library and otl^er campus facilities? Any study that can point 
to" similarities or differences in on-campus and off-campus education 
is going to be quite important as the trend toward non-campus-based 
progriuns ac^'elerates, 

V hv (j^uestiim of Effect ive Teaching 

The ([uestion of effei'tive teaching has never been clearly addressed 
on the campuses and there Is no reason to believe it wil.l be resolved 
by studying tli/) faculty at off-campus centers. Nevertheless, certain 
questions can he asked: Do the part-time faculty feel like second- 
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class citizens? How does their status affect their teaching? The 

I 

old question, "is anyone learning anything?", arises anew in the off^ 
campus setting. How can the "right" ansv/ers be obtained when, accord- 
Ing to Richard Meeth(l2), project director of the 1976 Change Report 
o^n ^ t there is "no consensus about what is important to 

Improve" despite the existence of 80 college and university centers 
on the Improvement oL teaching? Meeth does not restrict his com- 
ments^ 'to the teaching of nontrcidlt lonal students, as does Hagetneyer, 
or the successive wave of new students, as does Knoell, He includes 
all students, "old and new, traditional and nontraditional • It. may 
very we] I be that teaching the nontraditional or the new students Is 
a more arduous tasks than teaching the traditional or the old students, 
but tills does not diminish the universality of Meeth' s thesis thdt 
the evaluation of teaclilng is a stateless art. This is discouraging, 
but research on teaching effectiveness must go on not because legis- 
lators mandate It but because researchers must continue to explore 
every avenue In tl\e hope of finding a Rosetta Stone that will give the 
clues that Unk learning and teaching, Incide. .tally , after his bleak 
three-page essay on "The Stateless Art of Teaching Evaluation," 
Meeth, to help create a better base for evaluating teaching effec- 
tiveness, presents more than 30 reports on exemplary teaching. 
Some ot this reasoning may account for the large number of documents 
received at ERIC on teaching methods and effectiveness. 

In this paper, I do not wish to give the impression that the 
new forms will, completely displace the old ones. Far from it. For 
as manv years as we can safely predict, traditional learning will 
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continue side by side with the nontradittonal , In fact, much of the 
traditional Is currently Incorporated in the nontraditlonal in poorly 
disguised form, So for the researcher the old topics will still be 
around. But in nearly all areas, nontraditlonal study exacerbates 
old problems and introduces new ones. One need only mention teaching 
effectiveness, part-cime students, part-time faculty, collective bar- 
gaining, faculty workload, tenure, financing, government patterns, 
and tuition to realize not only how much more complicated research 
has become during the last five years but how much more needs to be 
done. For example, research on workloads of full-time Instructors 
teaching full-time students at fixed locations In traditional set- 
tings has proved exceedingly difficult; research on workloads of full- 
and part-time Instructors teaching at several locations and using 
nontraditlonal delivery systems will be a much more complex project. 

le chnl cal-Vo cat lonal Educat 1 on 

While reviewing the documents received at ERIC, I picked a few that 
may be of Interest/ to you because they are receiving national or 
regional attention. Flow studies continue to be prominent among state 
and locnl documents with a large number relating to follow-up of 
technical-vocational graduates. Since January 1975, ERIC has pro- 
cessed 18 follow-up studies In technical-vocational education, The 
emphasis on the technical-vocational Is understandable In light of 
t!;e enthusiasm for career education. In return for generous state 
and federal appropriations, educators are being pressed for evidence 
that career education is not only prospering In the colleges but 
that students In the programs are being prepared for and are getting 
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Jobs related to the programs. Perhaps the report by Wllms(17) that 

•*only two out of ten graduates from both the public and proprietary 

schools who chose professional or technical-level training ever got 

those Jobs'* may also have sourred activity in this area, 

A 1976 :oll()w-up study(l4) covering the graduates of the 13 

regional Institutes of the Indiana Vocational Technical College is 

mere favorable than Wilms' stud> With a 58 percent response, the 

.study found that 449 or 83 percent of the respondents were employed 

in Jobs related to their IVTC training. Of interest to researchers 

is this paragraph in the Background Statement of the study: 

A continuing major problem is separating the "value 
added" by the school experience as compared to the 
effects of non-school activities. Therefore, the find- 
ings of the follow-up studies should be viewed as com- 
^ponents of a comprpihensive system for evaluation of 
instructional and 3upportive services. 

Many of the follow-up stu^iies of graduates of occupational pro- 
gramr received at the c: 2c;ringhouse have clear research designs. Their 
population Is weLl defined, sampling techniques are consistently ap- 
plied, quest Unnaires are thoughtfully constructed, and data and 
recommendations are clearly reported. Many studies^; f all short of the 
mark. As you are well aware, survey techniques and sampling pro- 
cedures have been refined so that there seems no excuse for the basic 
errors that are made by many IR directors who set out to assess pro- 
gram graduates. An IR director might develop apd publicize a statement 
of the pro<:edun?s he woulo employ in working with any program director 
to assess the graduates of that program. The same techniques can be 
used tor mu.^t occupational program follow-ups, and if similar for- 
mats are employed, multiple studies can be conducted at minimal cost. 
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Another type ot flow study involves the reverse transfer students 
(tht)se whu transfer trom four-year to two-year colleges) who are en- 
rolling In larger numbers than before the recent economic downturn 
In emplovffienL ot graduates ot tour-year colleges and universities. 

. Interest In this group is so widespread that a review of the liter- 
ature by Ms. Robbie l.ee(ll) ot the HRIC staff has been prepared for 
publication in the Comp.unit^ College Review . Although Ms, Lee cites 
many studies touching on reverse transfer students, she considers most 
of them inadequate "because of the paucity of data available, the 
small samples studied, and the contained geography. Moreover, the 
rapidly changing student population and the expanded definition 

^ ot reverse transfer require new approaches to this topic," 

The studies of reverse transfer students to date have been limited 
for the moat part to head counting. It is time to move into another 
phase. Some of the reports coming into the Clearinghouse include 
interview data and confirm the supposition that spme populations, 
at least in the initial stages of study, may well be addressed 
through the interview technique. By doing carefully structured inter- 
views on rn age-graded sample of your colleges' reverse transfer 
population, some of the important reasons why this group has grown so 
large may appear. The Interview is a useful technique for deter- 
mining the proper questions to ask in a broad-scale study. 

An area that is hardly torched by researchers is the effect 
that Increasing tuition has had on enrollment and on the composition 
of enr(^llment, (^ne ot the findings of a recent study of Bishop and 
Van I'vkin oii institutional and adult participation In higher education 



113 




t 




• was that when tuition v/as eliminated, the college attendance rate of 
adults doubled. Is thf.-re a converse to this finding? 

By contrast, one of the most popular subjects of research is 
the part-time instruct.or. It seems as if every institutional research ' 
director, every professional association, and some state offices have 
produced a study on this topic. And the end is not in sight be- 
cause there are many facets to this subject including possible leg- 
islation or court action. 

A Growing National Concern 

The concern with research on a national level comes at an appropriate 
time in the history of the commuaity college— a cine when it is recog- 
nized as the most dynamic segment of the higher education and seemingly 
immune to the population slow-down, a time when it is undergoing 
changes in its mission, organisational structure, and student compo- 
sition. In adult education, this change impinges on other segments 
of education, and in the community education area, on public and 
private agencies in the social services area. It is also a time 
when research on the local, state, and national level is accepted 
more universally.' than ever before. What is most reassuring is that 
there is a greater awareness on the part of community college leaders 
of the need for continuous assessment of the various aspects of the 
enterprise. That we have not been successful in measuring effective- 
ness is discouraging, but our recognition of this lack of success 
will result in renewed efforts in this area. It is also encouraging 
that research on the institutional and state level is becoming more 
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widespread and that research organizations and foundations are giving 
more attention to the problems of the community college. 

At ERIC, I find that research at all levels interacts, and in- 
stitutional research directors are becoming less parochial. More sig- 
nificant is that researchers outside the institutions are associating 
more closely with those inside and are making extensive use of insti- 
tutional research. The requests that come to ERIC from those 
planning national studies are encouraging. During this year, there 
were requests for searches on part-time faculty, flow studies, effect 
on enrollment of the opening of a new college, criteria for intro- 
ducing a new program and for dropping a program, courses most likely 
to drop in attendance when total enrollment drops, and information 
on systems of governance which describe state and local rela- 
tionships, I am optimistic about national (and Institutional) re- 
search during this period when the community college is experiencing 
a profound change institutionally and educationally. 
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DEVELOPING ISSUES AND COMMUNITY COLLEGE RESEARCH 

Dorothy M. Knoell 
HUher Education Specialist 
California Postr'acondary Education Coinmissibn 
Sacramento, California 

The Plon ninj^ Problem 

The predominant issue at thij time appears to be the nature and 
locus of planning for community colleges in the late 1970s and beyond. 
It is qultd clear that planning modes which worked well in the past,, 
^ in an era of rapid growth, are no longer appropriate. Failure on 
/ the part of the colleges to adopt an aggressive new planning mode 

/ 

•night well result in the locus of responsibility for planning being 

/ 

/ moved from the campus/institutional level to that of the state plan- 
ning agency for postsecondary education, the legistlature, the 
Htate finance agency, or some other noneduc^tional entity. The prob- 
lems which community colleges face are basically those of declining 
state funds, pressures to provide opportunity for postsecondary 
education for ever more diverse student clienteles, and the absence 
of long-range goals and values to serve as a framework within which 
to establish priorities. 

Past planning for community colleges tended to be mechanistic 
but effective as an essentially responsive, reactive mode. Enroll- 
ments were projected for fiv^- and ten-year periods, using past 
participation rates of recent high school graduates and others; 
facilitirs plans were developed for new campuses/institutions and 

adciitlonal facilities on existing campuses; educational/occupational 
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programs were planned for the projected enrollments., and faculty and 
staff recruited to work in them; and, finally, when increased funds 
Vvire needed to accommodate the accelerated demand for postaeconda-y 
opportunity, bond issues and tax proposals were submitted to the 
voters. 

These planning efforts were highly successful, in California and 
elsewhere, insofar as they resulted in buildings being built, faculty 
being on board, and college catalogs being printed in time for the new 
students who enrolled each fall. However, the operational goal of such 
planning was simply .to be responsive to local needs for postsecondairy 
opportunity — first, the needs of lower middle class students who were 
either unprepared or unable to pay the cost of university enrollment 
as. freshman; then the needs of ethnic minority groups, many of whose 
numbers were more disadvantaged than Caucasians from the lower middle 
class; and thence the needs of the unemployed, adult women, others 
whose education had been interrupted, senior citizens, the physically 
handicapped, the mentally and emotionally handicapped, and the insti- 
tutionalized (prisoners, rest-home residents, and others who could 
not come to the campus) , 

Responsiveness to diverse clienteles has been tacitly assumed to 
be highly correlated with effectiveness. Institutional master plans 
began to incorporate sub-plans for programs and services to the disad- 
vantaged, f4f firmative action programs for students and staff, adapta- 
tion of tad 1 1 cits and programs to accommodate the physically handi- 
cupped, and outreach programs for those who found it inconvenient to 
come to the campus, Evaluation cften stopped with an assessment of the 



extent Lo which plans were implemfented-»-f or example, the enrollment 
of students with specified characteristics and the development of 
special programs and services. At best, evaluation included the 
sampling of attitudes and opinions of students and staff about the 
opportunities offered. The absence of evaluation activities parallel- 
ing the planning effort is a serious omission when attention is not 
given to student outc omes , cos ts once programs are ope rational , and 
long-term impact on institutions and the community. 

It Is proposed that future planning In community colleges should 
be goal- and value-oriented, proactive so as to point collegie develop- 
ment In desired directions, and with evaluation of effectiveness as a 
vital compdnent of planning and development, 'It is assumed that Active 
planners ran have some control over the destinies of their colleges, 
in ways other than simply cutting budgets and limiting opportuni- 
ties. The research role is obviously quite different from that 
played in a reactive planning mode, that is, planning in response to 
increasing demands tor postsecondary opportunity. The aggressive ^ 
research worker will participate as a planning team member in con- 
structing possible tut.ures for the college, choosing goals and 
objectives related to preferable futures, designing courses of action 
likely to take the college in desired directions, and evaluating the 
extent to which the college is so moving, 

Comrjunlty colleges have seldom subscribed to the notion that they 

N 

should be "all things to all people," although past planning activities 
sometimes appeared to support this idea, It is quite clear now that 
priorities will h^ive to be set among clienteles, programs, services, 
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and deUvtry sy.stems as part of planning for the future, the process 
will ho less arduous H planners have long-term values and goals 
, avallahU- to them as guides in establishing priorities,, as well as the 
results of evaluations ol effectiveness, including costs, of past .ef- 
.. forts to serve partlpular clienteles. 

^ Sub issues In Flanutnj ^ 

The first suhlssue of strong current intetest is the extent to which 

pressures for (1) reglonallzation and (2) intersegmental cooperation 

« 

will reduce Institutional autonomy in planning and management of. 
resources. Postsecondary planning has traditionally been horizontal In 
nature with each type of institution developing its _own plans which 
are then agsregated at the ^tate level as a plan for that segment or 
system such as public community colleges. In recent years, laws 
have been enacted In several states which either encourage or man- 
date cooperative planning and • development on a regional basis, often 
cutting across both communUy college district lines and involving 
different tvpos of In.^t Itutlons (public and independent, degree-grant- 
inn and with non-credit offerings). Such cooperation may result in 
saving.^ to L'ommunlty colleges with no diminution of services to 
residents ot tht^ region. However, autonomy, in planning to establish 
priorities amonK rLtenteles and programs will be reduced and evalu- 
ation ot ofuu^tlveness will be moire difficult to perform by research- 
ers- at parrltular Institutions. 

A second snb issue oi growing importance is the extent to which 
manpower needs (local, regional, and state) should Influence program 
development and continuation in the community colleges. The oversupply 
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and underut 1 1 Izat Ion ot trained workers In some fields appears to have 
gr.i*ater potential Impact on planning than the shortage of trained 
workers Ln other t lelds. The Issue becomes critical when student de.- 
inknd tor training In tields with excess manpower is high and the 
cost oi ottering the programs relatively low. A different" type of 
problem arises from planning ^to discontinue occupational education 
programs which are no longer needed, In which there are tenured 
faculty who are not prepared to teach In other fields. Past planning 
has produced an over- increas ing diversity of occupational cu*.ricula 
to prepare students for employment In fields for which the need for 
a coiranunitv college program has at some time been demonstrated. 
Future planning modes will, of necessity, deal with priorities among 
new and ongoing programs, taking into account not only costs and need, 
but also community values and college effectiveness in producing 
such trained manpower. Still another related subissue of particular 
Importance to community colleges Is the proportion of students who 
should receive specialized training for employment, given the fact 
that less than two-thirds of the labor fotce needs such training 
beyond what can be given on the Job in a matter of hours or days. 
Pressures are now on students to enroll in programs in which they 
acquire particular employment-related skills, regardless of society's 
need for tlie large numbers so trained. The problem is a vexing one 
ior Institutions which tor many years wete concerned about the disin- 
terest ol students In occupational education. 

The apparent Insatiable demand for adult and continuing educa- 
tion during a time of llmltt^d tinanclal support for the community 
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/colleges la producing still another sublsaue In planning. In essence, 
i the issue Is the proper role of thu conmunlty colleges vis-Vvis the 
public schools and other Institutions pf postsecondary education 
offering noncredit courses and programs. to local residents who are 
beyond compulsory school age. The courses at Issue range in educa- 
tional placement level from elementary school subjects for the illit- 
er^te, through lower division programs, to continuing in-service 
education fof technicians and professionals who do not need college 
credit for such experiences. The issue is often resolved by tradi- 
tion and/or negotiation among the various parties which are legally 
authorized to offer such programs. In other situations where negoti- 
ation fails, the result 'is duplication of opportunities for 9ome 
clienteles and the neglect of others, usually the poor and underedu- 
cated. There is little research available on the effectiveness of 
adult and continuing education programs offered by different types 
of institutions, as a basis for future planning in which priorities 
must be established and choices made. A critically Important sublssue 
is basically the question of financing adult and continuing education 
and the extent to which users should be expected to pay the costs. 
High enrollments and a high degree of satisfaction among enrollees 
in current programs are inadequate measures of effectiveness in a 
time of scarce funds for community colleges. 

A fourth sublssue Involves the use of publicly funded student 
finanoLa! aid to achieve institutional goals developed as part of a 
long-range plan, The federally funded Basic Opportunity Grant program 
has done a great deal to reduce institutional involvement in the 
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awarding ot st.udent aid Based solely on need. Still, the vastly in- 

I 

creased amount of student aid now available to community college stu- 
dentsj and others^makes it imperative for planners and researchers to 

1 

add student aid to the mor'j traditional dimensions of college 
planning — that is, enrollment projections, program development, de- 
livery systems, 'and costs. Questions of effectiveness which may be 
researchab le include the following: . . 

1, How can student aid funds be administered so as to open 
up postsecondary educational opportunity to- types of 
students nor now fully served (as opposed to 'hiding those 
already, coming to college who have unmet need)? 

2, Will increases in students aid result in increased per- 
sistence to degree and other objectives on the part of 
these awarded such aid? Should it be used to enable part- 
time students who are employed off campus to enroll full- 
time? 

'J, What is the effect of student aid on choice of institution, 
attendance pattern, and field of study and/or career? 

Issues In Feder^il/State/ Inst i tut ional Relations 
• The issue which appears most ominous for the community Colleges in 
the late L970s is the increasing demand for comparability of defini- 
tions, data, and information tor all types of pos tsecondary insti- 
tutions* The demand is being pressed by both the state and federal 
governments, sometimes in ways which are in conflict. The issue is 

r 

embodied in the recent attempt of the IJSOE National Center for Edu- 
cational Statistics to develop under contract a manual of postsecond- 
ary student terminology — terms, definitions, and guidelines for 
records and reports about students in pr stsecondary education. The 
manui.l attempts to standardize terms and tlieir definitions not only 
tor degree-granting Institutions, including community colleges, but 

123 

ERIC , 



also tor specialUed poatsecondary institutions which do not operate 
on a .system of credit tjours, semesterH or quarters, or degrees 
awarded • 

Standard temlnology is urgently needed to facilitate the .collec- 
tion of comparable information about costs, productivity, persistence, 
.and other outcome measures from widely diverse types , of postsecondary 
Institutions and programs. On the one hand, community colleges are 
to be compared with adult schools operated by K-.12 school districts, 
publicly funded area/regional occupational centers, and proprietary 
schools offering vocational /technical training. At the other ex- 
treme, community colleges must develop data and Information which 
will be comparable to that furnished by both public and independent 
colleges and universities offering lower-division ^programs! It is of 
little use to point out that community colleges are different from 
each and all ot. these postsecondary institutions and that attempts to 
obtain "comparable" information no violence to the uniqueness of the 
community colleges. Instead, research workers and others must begin 
to cope with the issues of comparability by proposing areas where new ' 
agreement might be obtained about common definitions and measures of 
costs and outcomes. 

More frustrating but less threatening is the issue of the 
ever-increasing requirements tor state and federal reporting by post- 
secondary institutions, all of which tend to reduce the amount of 
staff time available fnr active planning and evaluation. The announced 
intentions L^^ the federal government to hold constant or reduce re- 
porting requirements tiave been accompanied by increased complexity of 
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HEOtS (Higher Kducatlon General Information Survey) reports with re- 
spect to ethnic-racial data. Attempts by the states to coordinate 
« and tlVus control the volume of required reports may result In an 

additional burdt'n to institutions' which must reprogram their computers, 
^ revis» forms for data colL.^ction, and make other changes in the ways, 
they have traditionally produced the required reportSt 

Two sub issues related to reporting requirements appear wox^thy of 
mention. The first is the ability of the community colleges .to 
have impact on reporting requirements for all' postsecondary institu- 
tions when they are chnnged at the state or federal level. The his- 
torical place of the community c^plleges somewhere between the public 
schools and higher education has meant often that^ the two-year colleges 
have had least impact and suffered the most from imposed reporting 
requt remt»nts, Thje second subissue concerns the utility of the re- 
quired reports for institutional planning^ management, and evalu- 
ation. Institutions tend to view such reports as necessary burdens 
to staff and to ignore the potential usefulness of the data for local 
operations. HECilS and similar reports have the advantage of producing 
data from a common set of definitions used by all institutions in all 
states and of yielding low-cost computer tapes annually which can be 
used to obtain comparative data over time and between and ionong 
institutions and states. The standardization of data is of course both 
an asset and a liability for community colleges in that some definitions 
are a poor "fit" for their operations and others are too gross to be 
useful in local analysis. Still, HEfUS and other federal and state 
reports can provide the basic data for the annual monitoring of the 
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condition of postsecondary education in the particular Instlrutlon, 
system of postsecondary education, and/or state. Such monitoring 
should show trends and other changes in selected aspects-for example, 
degrees and certificates awarded by discipline-which can be analyzed 
in .terms of plans and projections for the institution. 

The Kvaluation of Effectiveness 

It U well known that the faith of the public in higher education as ' 
the producer of better Jobs, higher income, and more comfortable liv- 
ing generally tor those who partake of it has diminished in recent 
years as a result' of many factors beyond our control, while public 
confidence in higher education does not appear to have reached the 
level of distrust which has been experienced iri politics and govern- 
ment recently, there Is neec} to find ways to demonstrate to legisla- 
tors, state executive officers, and even lay boards that community 
colleges are effective in performing their assigned functions. Tradi- 
tional Indices of effectiveness are no longer sufficient— accredi- 
tation. Increasing enrollments, favorable student attitudes and opin- 
ions, transfer student performance, and place.nent of graduates of '■ 
occupational curricula. All of these may be necessary but are not sufr 
tie lent measures of effectiveness in an era of limited state funds 
for the support of postsecondary education. 

Institutional research encompasses much more than the evaluation 
of effectiveness, but evaluation is viewed as one of the most im- 
portant components, particularly as it relates to planning, it is 
proposed that a comprehensive program of evaluation in community 
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colleges, would Include each of the following, with variation in scope 



and intensity d- .pendent upon local circumstances: 

1. An annual quantitative description of the condition of post- 
secondary education at the particular institution, with 
trend data and statewide and/or national statistics, as 
appropriate ; 

2. A qualitative analysis of selected aspects of the institu- 
tion's condition that relates what has been observed to what 
was projected and planned; in other words, an analysis of 
whether the Institution is growing and changing in desired 
directions or remaining In a preferred status quo condition; 

3. An annual assessment (using data collected routinely for 
other purposes) ot the extent to which particular goals and 
objectives In the Institution's plan of development have 
been achieved such as implementation of an affirmative 
action program with specified results for a particular period 
of time;' 

4. Periodic (perhaps every five years) evaluation of instruc- 
tional outcomes related to institutional objectives (usually 
requiring special data collection) such as competences ex- 
pected from general education proarai^**^^ writing and compu- 
tational skills displayed by graduates; and 

5. Participation by research staff in the evaluative aspects of 
special programs for particular clienteles — for example, 
oducatLonal opportunity programs and services for the dis- 
advantaged. 

Con e l u s I o n 

There is a stronger need now than ever before for institutional re- 
search staff to be active participants in community college planning 
to Insure that institutions are developing in desired directions, A 
major Impetus for this activity is the necessity to make choices and 
set priorities because of expected limitations on funding which are 
likely to extend well Into the future. While community colleges may 
continue to grow, it seems likely that future growth will be con- 
trolled so as to give priority to certain clienteles, programs, and 



delivery systems. Legislators and others outside the Institution 
will net priorities and limitations if institutions do not dc so in 
an elitiCtlve manner. 

The most important issue now facing community colleges is be- 
lieved to be the nature and locus of planning for tKe future. This 
belief rests on the assumption that colleges can speculate about 
alternatives., specify values and goals, establish priorities, and 
dc^clde on preferable futures that are possible under the law and in 
the particular community setting. Wlien planning Is done in this fash- 
ion, the evaluation of institutional change In terms of the specified 
futures Is a complementary activity. Thus, institutional research 
workers can use their talents to contribute to both planning and 
evaluation, 
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TOE CASE FOR STATEWIDE COORDINATLON OF 
INSTITUTIONAL RESEARCH IN THE COMMUNITi' COLLEGES 



Ivan J. Lach 
AssoQlate Director for Planning and Research 
Illinois Community College Board 
Springfield, Illinois 

In t rod iu^ t Ion 

The need for Information about community colleges at the state 
agencv level has increased substantially in redent years primarily be- 
cause the amount of state funding for the community colleges has in- 
creased very dramatically. Data requests by the legislative staffs, 
the budgeting agencies, and the governor's office often seem unreason- 
able, are often demanded on short notice, and the data that are ob- . 
talned are often misused. Kor these reasons, most institutional re- 
searchers have very negative reactions to any state agency surveys 
or data requests. However, it is usually not prudent to deny data to 
the legislature or the budgeting agency that is going to be asking 
critical decisions about funding community colleges; therefore, 
tht> prudent approach is to develop a well-desigued system of 
needed Infon/iatlon about community colleges at the state level, a 
system that will be able to respond to the majority of data requests 
with validated and well-presented information. 

To achieve tills goal, a positive rather than reactiona ry ap- 
proach to snate-Ievt'l Institutional research must be established. Such 
an approach Is necessary because : 1) there is an urgent need for 
state-levtvl Information about community colleges which critically 
affects decisions on state funding, proj;ram and course approval, 



and other Important policies: 2) there is a need for comparable data 
about community colleges for local and state uses; 3) there, is a need 
for ^ordination of the research effort among the various institu- 
tions within the state; and, 4) there is a need for state-level 
leadership m institutional Research in the community colleges. 

State-Level Need., fnr Information 

Many Important decisions are made about community 'colleges at the 
state level, often in haste and sometimes with very little hard 
information to help m the decision process. The community colleges 
must compete for limited state revenues with many other institutions 
in the various state agencies and the legislature. For these pur- 
poses. It is not only important to have the relevant financial in- 
formation but also information which shows community college outputs. 
In addition, many states control the program- and course-approval 
process for the community colleges at the state level as well as a 
number of state policies which affect the colleges at the local 
love I, Decisions of such magnitude demand well-developed and well- 
defined data about community colleges. To meet the state-level 
information needs, the institutional research effort at the state 
l.?vel must .consist of developing precise and common definitions, 
comv.ivluMTs , ve management information systems, well-de signed surveys, 
and Ht„u:c.wluv follow-up studies of students. Types of information 
most otton u:-,.d at; tne ,5<:.v..^ level In Illinois are the following: 
).. Course and o . -.,! uta l.iwitoty (on-line computer file.) 
^. :-;t.udent Kurollmfnl: Data (rn-llne computer file) 

Colh-Ko Bud,;eL f.n.l Audit l-ata (on-line computer file) 
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4, Unit C03t Study (computerized) 

5* Facilities Inventory and Utilization (MIS-produced) 

b. Faculty and Administrative Stlary Survey 

7, 'Facuity Utilization Reports (MIS-produced) 

8, Student Follow-up Studies 

9, Master Planning Data 

Need for Statewide CQmp arable Data 

One of the major difficulties with statewide data is. the lack of 
comparability among institutions due to the use of different defini- 
tioasi procedures^ and*methods* This not only limits use of data by 
the state, but also the local college's use of statewide data or 
data about institutions which is needed for comparative self-analysis. 
The state agencies which coordinate the community colleges have a 
unique opportunity and an obligation to work with the colleges in 
adopting common definitiorm and conunon procedures for obtaining data 
routinely needed for statewide analysis* 

In Illinois, the public community colleges utilize the follow- 
ing common definition directory and manuals which were developed 
by representatives fr^m the colleges and the ICCB staff: 

1. Data Base Directory (700-page document of definitions) 

2. Uniform Accounting Manual 

3. Miinagement Int'omiat. .on System Procedures Manual 

4. Unit Cost Study MrvriuaJ 

5. Occupatlcmal Follow-Up Study Manual 

b. Resourct! Allocation and Management Plan (RAMP) format. 
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Th*i Neecl tor Statewide Coordination 

There la also a great need for statewide coordination of needed 
research in conununlty colleges. The statewide follow-up studies of 
students are prime examples of such needed coordination. In a state- 
wide transfer study, it Is essential to obtain the cooperation of 
senior colleges In providing data in a prescribed manner about the 
progress of these students at their institution. It Is likewise neces- 
sary to agree on what method.; and procedures to,, use in reporting the 
data from community colleges to ensure comparability. Coordination is 
also essential In Identification of needed statewide research pro- 
jects and obtaining tne necessary cooperation and support from each 
of the various groups that must participate to make the project 
possible. 

In llliuois, .the ICCB-.has a Research Advisory Council consistirs 
ptlmarliy of Institutional researchers at the community colleges as 
well as representatives from the Council of Presidents, the Trustees 
Association, the Faculty Association, the Students Organization, 
and the senior Institutions. This group has served as an excellent 
coordinator lor statewide research efforts in Illinois. The present 
Statewide Occupational Follow-llp Study was Initiated primarily as 
a result of the efforts of the Research Advisory Council. 

Thc_N^?ed tor State -l.evel Leadershljp 

Although some community colleges have excellent institutional re- 
search programs, the majority of them are very Inadequate iu this 
area, A survev ot the Institutional research function In Illinois 

Of a 



conununlty cul leges conducted In 1973 showed that only about one- fourth 
of the collegea had full-time Institutional researchers and that often 
these persons had many other responsibilities, A national survey con- 
ducted in 1^7^ showed similar resvLts. Hence, most community collegea 
need leadership anil encouragement at the state level to help In identi- 
fying the basic institutional research projects and in getting them 
accomplished, llie responsible state agency can mandate certain basic 
research studies and provide the necessary procedures manuals and 
workshops. Two good examples of this type of study in Illinois are 
the Unit Cost Study and the Occupational Follow-Up. Each of these has 
a manual which prescribes the procedures and methods tor be utilized, 
and several workshops have been held throughout the state with col^ 
lege personnel responsibJc- for each of these studies helping to ex- 
plain the procedure*^ and resolve any problems. The ICCB provides com- 
puter processing for the Unit Cost Study for all colleges and sends 
the detailed I'nit Cost Study reports back to the colleges for their 
use. 

Activities I would classify under the area of state-level 
leadership in ILllr, \rv as follows: 

1, Workshops and seminars on follow-up studies, unit cost 
studies, planning, and management information systems 

2, Development of a file and bibliograpliy of research studies 
In community colleges 

3, Adapting definitions and coding nystems which are nationalJ.y 
accepted such as the HKr;is and NQIEMS classification systems 

A. Provision through t..d MIS of certain basic utilization re- 
ports tor each college Including comprehensive facility 
utilization reports and faculty productivity analysis 
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^. Requiring basic studies such as unit cost and follow-up of 
students but providing manuals, standardized Instruments, 
computer processing, and assistance through workshops. 

Cone I us Idu 
■"^■^ ■ ■ ■ > . 

Althwu^h statewide data are difficult to provide, the people making 
decisions at Lh.» state level utilize whatever data is .available, 
Oiten rumors and hearsay are given uadue credit because data is not 
available to reveal the actual situation. Hence, lack of data or 
lack ot valid data can lead to decisions that might severely hurt the 
community colleges within a state. For this reason, I am advocating 
a posltfvv approach to Institutional research at the state level. By 
tliis I mt-an that a weU-developed system of providing needed statewide 
Intormatlon about community colleges must be designed and implemented. 
This system must be used on common definitions and procedures and 
must Itu'lude a management Information system component as well as a 
research ettort, A positive approach to institutional research at the 
stati' level will provide not only adequate information at the state 
levi'l but also statewide comparability of data, statewj.de coordination 
ot research efforts, and leadership for institutional researchers in 
the community colleges, 
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A USER-ORIENTED APPROACH TO PROGRAM EVALUATION 



Lorraine Beitler 
Associate Proteasor and Coordinator of 
The Allied Health Learning Center 
New York City Community College 
New York, New York 



There are two phases in program evaluation. The first phase deals 
with the design and development of the report, and the second with the 
role ot this report In relation to the user. There are many factors 
ttiat affect the teaching-learning process » and many of them are 
quantifiable. It may be useful to detail some of these factors, ex- 
amine an evaluation model, and explore facets of the evaluation 
process that bear on the effective use of data, 

Institutional research concerning faculty often involves analyz- 
ing taculty characteristics in terms of tenure; rank; years of pre- 
vious and current service at the institution; evaluation by adminis- 
trators, peers, and students; patterns of utilization of facilities, 
which may Include scheduled use of classrooms and nontraditional 
settings; use ot: media hard and software; and use of community 
resources. 

Institutional research concerning student s often encompasses en- 
rollment reports and projections; demographic data including such 
pretenure factors as age, socioeconomic statue and expectations; 
compilation of tenure factors detailing the college experience; and 
posttenure factors, vhlch may include student, faculty and em- 
ployer's perceptions of the college experience. 




ERIC 



Al mlnUtrators are concerned with program evaluation in terms of 
factors related to coat analysis, income, and expenditures; cjata ' 
assesi-lnR course loads in terms of frequency requirements! sequence 
and alternative course modules; transcript analysis for patterns of 
grading; and transcript analysis tor prediction of student success. 
All of these factors should be related to community data indicating 
Job market projections and employer needs. 

Model A on page 137, developed by Alfred and Be.itler(l), indi- 
cates the relationship of specifically designated input-output factors. 
It wa.s used In the evaluation of programs within the Division of 
Allied Health at New York City Community College. 

In his Discrepancy Evaluation Model for program improvement 
and appraisal, ProvusU) describes four stages for consideration in 
the implementation of a new program. The design sets forth the stand- 
ards on which a program is established and provides the basis for 
assessment. Installation focuses upon the extent to which program 
activities hav« been identified and attention has been given to 
corresponding task assignments within realistic time limits. 
Jnteractlon focuses on the appropriate procedures for communicating 
to the faculty, college administrators, staff, and students the 
.objectives and philosophy of the program and the services it provides. 
'The e v aluation stage should examine the degree to which the specified 
objectives In the project design have been met. 

The program design details the standards, directions, and 
strategies for the ' Implementation of the program. It establishes 
InlLlal objectives, major strategies for achieving these objectives, 
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ilodel A 
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and specific activities fur each strategy, m Model B on page 139. 
Ldchat(2) describes an objective appropriate to the design phase of 
a program. Objective II was identified by the project coordinator. 
Responsibility for each activity was assigned to a staff member, and 
time lines were estabUshad for out-components of each activity as 
illustrated in Model C. on page 140. This provides the basis for . 
assessing the discrepancies between objective- (standards) and oat- 
put (results) at interim periods. 

A staff management system can be used to track areas of 
responsibility and accountability that have been previously defined. 
The role of each staff member should be delineated in terras of: 
(I) the person to whom he or she reports, (2) the people he or she 
supervises directly, (3) major responsibilities, (4) working relation- 
ships, and (5) position tasks and the time required for them. After 
specific task assignments are made fpr various staff members, monitor- 
ing procedures should be carefully defined. Meetings must be regular- 
ly scheduled with staff members in order to assess progress. 

The relationship between processes and interim products, as 
they relate to the objectives specified in the project design, must 
be examined. Discrepancies between processes .and planned activities 
should be examined in terms of their Impact on the development of 
project products and the achievement of project objectives (see 
Model 1) on page 142) . 

The implementation of a tutorial service (see Model B) , for 
example, might not have been possible if there had been no congruence 
betweun the Iritt-nded activities and the actual activities. 
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MODEL B 



OBJECTIVE II 



Students enrolled in target freshmen courses for Allied Health Career 
programs will become more proficient in their application of learning, 
study, and test-taking skills* 

STRATEGIES 

I. Adjunct personnel will develop and implement minicourses re- 
lating content and learning skills in target required freshmen 
courses for Allied Health career programs. < 

II. Learning Center staff will provide a tutorial assistance 
training program to enable qualified tutors to function (a) in 
an individual tutoring situation, (b) in semirtar sessions, 

(c) as a tutor-in-residence, and (d) as a within-the-classroom 
• assistant. 



III. Comprehensive tutorial services will be provided for stu- 
dents enrolled In career programs in the Division of Allied 



Health. 
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MODEL C 

ACTIVITIES RELATED TO STRATEGIES FOR ACCOMPLISHING OBJECTIVE II 



ACTXVITIES 

Meetinijs will be held with faculty members of 
tcircjet required frea^inien courses to 

a, obtain their support in developing mini- 
courHe sessions to Apply learning, study, 
and test-taking skills to specific con- 
tent areas. 

b. ret|uest them to highlight aspect of 
c(jurrtes which are in nfn?d of program 
aupport, 

o. obtain courne wattirials and outlines. 

MLtil-coursef> of six.^ on<?-hour sessions will 

provided for target reqvi.ired course in 
MlieJ H«;»all:h career programs 



a. 
b. 



T<'ijt.-taking technicjues - 2 sessions 
Ciire<.M. voc.jbiiluiry - 2 sessions 
Application of math processes to 
0(M\t<fnt curricula - 2 sei^sions. 



RESPONSIBILITY 
Coordinator 



I* TIMELINE 

Oct. for first 
semester coursea 

Feb* for second 
semester courses 



Desianatcd Adjunct 
Personnel 



March 
April 



3 sessions 
3 
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ProcH'<luroa will be finalized with the 
Tutorial CeMter for the coordination of 
Horvices th^-ough the Allied Health Learn- 
ing Center 

Division students will be identified who have 
beLMi excessively absent, are in danger of 
failing, had dropped a course one semester 
and had re-eniolled or have shown a low 
prtitile in diagnostic and/or entrance exam. 

a. Form letters will be sent to identified 
Pivision students describing tutorial 
services available through Learning 
Cento r 



Prospective tutors will be identified 



Coordinator 



Coll.Lab.Tech, 



First week of Feb* 



Dec. -Jan. 



11 



First week Feb. 



January 



MODEL C (continued) 



ACTIVITIES 

5. Three tutor training sessions will take 
pUce related to: 

a. one-to-one tutoring techniques with an 
emphasis oh the dynamics of inter- 
personal relationships. 

b. seminar tutoring with emphasis on 
group relations 

c. assistants within the classroom situa- 
tions with an emphasis on faculty 
tutor tutee relationships 

d. procedures for accurate record keep- 
ing and follow-up of excessive stu- 
dent absence 

e. the use of tutor-tutee log 

f. the use of existing and newly developed 
materials for departments in the 
Allied Health Services 

Tutor tutee record (logs) will be reviewed 
weekly to monitor tutorial procedures and 
will be available for review by faculty 

7. Third session evaluations will be held for 
each tutor-tutee situation 



8. Mult i*^media instructional aids for rein- 
forced learning will be developed 

9. A final report on numbers of tutors and 
tutees participating in program, types 
of sessions utilized and materials used 
will be submitted to the Project Coord. 



RESPONSIBILITY 



TIMELINE 



Coordinator 6 Coll. 
Lab* Tech. 



Februa i.y 



Coordinator 



weekly throughout 
2nd semester 



Coll. Lab. Tech. 



Adjunct Personnel fii 
Media Coord. 



throughout 2nd 
3emester 

throughout 2nd 
semester 



Adjunct Personnel <■ 
Media Coord. 



throughout 2nd 
semester 



INTENDED ACTIVITIES 
INTENDED A OUTCOMES 



MODEL D 
Congruence 
Congruence 



ACTUAL ACTIVITIES 
ACTUAL A' OUTCOMES 



At this stage the Identification of discrepancies between in- 
t«nded activities (plans) and actual outcomes (products) does not 



and can now document modifications in operations that may be situa- 
tional responses to specific conditions. But the absence of the neces- 
sary tacllltles, for example, might severely impede various activities 
so that products cannot be delivered by a specified time. 

The Role of the User 

Often the thickness of a report is inversely proportionate to its 
shell life. In order to ensure that the product of evaluation will 
not be relegated to a shelf until it is outdated and useless, we 
muit change the role of the user from a passive to an active one. 
Reflect on the following: 

F}' Wrusi: Voltage Point Will Judgemente Be Made? 

I. Whii Is the audience who will read the report? 

Will they have a vol§e in the design of the evalt4atlon? 

A, Administrators 

W i Department chairpersons 

C. Kaculty 

n, Students 

E, Employers 



necessarily have negative implications. Evaluators have in the past 
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Who complies and examines the data? 
A» Nonveated Interests 



1. Outside the college 

2, Inside the college 

B» Possible vested Interests 

1, Program coordinator 

2 , Department chairpersons 

3, Dean of the division 

4, Faculty 

III, Are the procedures for collecting data viable? 

Are the source and the organization of the data credible? 

A, Quant 1 tat Ive data 

I • Entry — pretenure 

2. Interim — tenure 

3. Output — post tenure 

B; Qualitative data 

U Ques*^ ionnaire 

2« Interview 

3, Seminar or conference 

4, Standardized tests 
5« In^-house tests 

IV. Are the Indicators for measuring success considered valid 
by the user? 

A, Patterns of utilization of services 

B, Nature of clients 

C, Perceived effectiveness 

To provide a viable evaluation product, the users should be en- 
couraged to participate In determining the components to be included 
In the final report. The results of Investigating a sequence of apeci- 
fii»d activities (teaching methods, content, facilities, and so 
forth) must be communicated to staff members at all levels, and 
their recommendations must be heard so changes conducive to the 
attainment of the program objectives can be implemented* 
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Kvaluatlon should be concerriLsi with the ImmecJlace aud summa- 
tlv./ unuluctH— t,hf pro.-o..sso.s unl ao'.; : vl t U's l.^adlns the product. 
Appraisal by .-.Vivluat ion. with th,.; bei,.' jf the us^.r, In the Interim 
staKf.* ot the f>ru,,r™ car, provide oarl ..islghta, and th«n the pro- 
Kram rati b... revlstnl in progresr. to t^nhaiu o : ^ ■ sue ess.. Open chan- 
nels tor c-ommun(catk.n, both vertically and hn.lzanf -l.ly, with 
Involved statt and faculty ,.ive a nm«t if tti.o .-valuator is to be 
effiH-tlvi-. With such commuMlcaLlou, the format3v«- evaluation can 
become part ot the dec Is lon-raaUng process, muI the ^vaJucitor can 
he perceived as a helper who will reinforce good performance and 
suggest corrective alternatives. 
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MXNACKMENT AND KESKARni: AN ESSENTIAL PARTNERSHIP? 



Boris HlaL, Jr. 
Dean ot Administration - 

flarcum Junior Coi.lege 
hrvH' Mawr, Pennsyivania 

In the midst ot insistent demands for accountability, self-analysis 
by educational institutions is now an urgent necessity. Research and 
(k'velopment In both conmiunity and private Junior colleges is taking on 
new dlmousltMis. In the collection and analysis of pertiner\t informa- 
tion, groat emphasis is beii^R placed upon data bearing directly on 
docision making rarher than on mere presentation of statistics in 
support of some theoretical design. 

As Schoter and Turner noted in a 1970 topical paper to the 
Klorlda Community Junior College Inter-lnstitutlonal Research Council: 

The last few years have seen a growing inquiry into whether 
community colleges arc, In fact, fulfilling the high aims 
')nce so confidently announced. Though still muted, demands 
tor ev.dence are beginning fo be heard. Even the most 
ardent proponents v^f the movement appear to recognize short- 
comings and a consequent need for a firTner base for insti- 
tutional phllos<^phy and methods that would come from 
empirical studv. 

Snyder, in KKtC Junior College Clearinghouse Topical Paper 30, 
has observed: 

The press lor accountability has descended on tlie two-year 
college aitd cannot be put off. Legislators, board members, 
taxpayers, even students and parents, are asking the col- 
lege to account for its efforts and resources. It must 
respond, for the alternative to self-examination and direc- 
tion Is submission to interests beyond the college. These 
it)ndltlons have given critical impetus to the role of the 
institutional researcher. 

lor an hvui tut ional research program to be of maximum value to 
an iU>;,Mil/at Ion, it should embrace ongoing assessments of: 



(1) allocation of resource^;, (2) student potential, (3) institutional 
achievement, (4) curriculum and program needs and ordered priorities, 
and (5) community Impact of the college. 

What follows are the highlights of how one small-enrollment 
(650 students), private, Independent Junior college for Women analyzes 
its efforts as a learning center for young wumen. 

At llarcum, institutional research is a shared activity, Faculty^ 
participate in ;^'^l<cy deliberations through four active committees, a 
Faculty Assembly, and a College Council, In 1970-71, of some 72 policy 
and procedure actions recommended by these groups, 21 were bashed, in 
part, upon documented research inquiries by various faculty members, 
in addition, at the request ot these various committees, the Office 
of Research conducted 14 additional inquiries furnishing information 
which facilitated subsequent deliberations and decisions, 

To help insure an orderly, ongoing, and comprehensive program, 
we used a checklist of areas for inquiry, which has been a very 
useful guide at Harcum — botvh for cyclical, long-range trends analysis 
and planning as well as one-shot inquiries to collect data for the 
resolution of immediate problems and concerns, Since 1963, the Office 
of Research has prepared some 420 research report!^, memoranda, and 
briefs as well as 120 published articles. 

The various studies, inquiries, and investigations we cQnd,ucted 
during 1^^71-72 may be conveniently grouped into three categories: 

(I) Experimental Research (40 percent) ; These generally in 
volved thi' experimental manipulation of selected (independent) 
varialiles, olten with the use of experimental and control groups to 

Irr 
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note what effects, If any, occurred In the criterion (depenaent) 
variableH, 

(2) Survey Research (50 percent) ; Researchers collected data 
by questionnaires, analysis, and records of interviews taken from 
samples of whole popular ions • 

(3) Historical Research (10 percent) ; These particular records 
analyses sought answers to questions by referring to valid college 
records and the institutional research offices subsequent statistical 
treatment of the historical d.ita. 

The principal techniques that have been utilized for data col- 
lection have included: bef ore-and~af ter evaluations; checklists; 
correlational studies; interviews (both structured 'and open-ended); 
tests and inventories (including academic achievement, skills, and 
personality assessments); observation schedules; replication investiga'* 
tions; questionnaires and opinionnaires ; rating and ranking schedules; 
and statistical treatment of data. 

Since Harcum is a private junior college, without public tax 
support, the financing of its institutional research effort is wholly 
determined bv college executive management with no sustaining public 
monies. Such monies become available only through individual grants 
received for the conduct of specific programs or projects or, in the 
case of private foundation grants, for the support of 3pecific re- 
search steadies • On ,occasiini, when , the investigation subject so 
warrants, funds arc furnished by the appropriate college department 
(an academ^ division or adminlF .ralive office). In this connection, 
it is strongly recommended that the institutional research office 
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tunctlon as a service a^.-ncy to the college (and the faculty, in par- 
ticular) and Ktiard aKatnst becoming a bumptious bureaucracyl 

lix 1971, soim. 40 percent of the Uiculty and staff voluntarily and 
anonymously responded to a questionnaire requesting their candid 
evaluation of the Institutional research reports furnished them. 
Virtually all of the respondents (94 percent) rated these reports on 
^ a five-ad.)ectivi' scale of "Exceptional," "Considerable," "Some,". 
"Little. "-and "None," to fall within the range of "Exceptional" to 
"Some." Most respondents (52 percent) specified "Some" — the mid- 
value rathiK on this five-level scale. No'claim is laid to equal-step- 
Kapplng, or other sophisticated measurement techniques for this 
slmpl.e, face-valid rating scale. 

Since Harcum decision makers continue to seek improved methods of 
college operations, the rationale for institutional research at the 
college is crystal clear and compelling. Under the leadership of a 
progressive, responsive management, institutional research has moved 
into the mainstream of college operations. By becoming directly in- 
volved In filling Information j^aps . it Is relevant to all institu- 
tional problems, concerns, and operations. 

It is axiomatic but nonetheless pertinent to note that without 
the wholehearted endorsement of executive management, the essential 
staff-servtt-e function of Institutional research is either an im- 
possibility or simply a meaningless, wasteful window dressing. The 
financial support of Institutional research should not be left to 
chance alone. If a research program is considered Important, 
specific and reaHstic provision must be made for it within the 
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college hudget, At Harcum, management h, is -totally supported insti- 
tutlunal researeli, permitting treedom ot' inquiry, follow-up of 
leseariM) tindlngs, and necessary financial support, 

Nlcliael Si:riven's phrase "Results Rather than Rhetoric" might 
well he the motto tor institutional research. After all,' not only is 
the phrase alluringly alliterative, but it conveys a commitment to 
empirical evidence and a dismissal of mere word wizardry I And ^io 
at Harciim, the pragmatic answer to the question "Why Institutional 
Research?*' has been that we have found it provides ways and means 
for identifying and analvzing the college's problems objectively. 
This l>; the tlrst major step toward improving current programs and 
operations iind planning intelligently for the future. In short, to 
avoid the twin pittalls of complacency and misdirection, ongoing 
institutional self-study is a necessity. 

Numerous management specialists have suggested that education, 
like industry, should ask many searching questions of itself. It is 
particularly important to recognize that the need for, and the 
invii IvtMnent of, teaching and administrative faculty in on-going, self- 
evaluation designed to improve college operations (which, incidentally, 
Is probably as useful a definition of institutional research as any) 
is as great in the two-year college as it is in the four-year 
institution, In these davs of accelerated change, the two-year, 
postsecondarv college L-an no longer be casually relegated to the 
"little sister" category, not when It Is anticipated that within a 
scant S vears, 40 out of each 100 students enrolled in higher educa- 
tion In Amcr U-a will be in two-year colleges. Stuart Marsee, former 
president ot Santa Ke Community College, has said: 
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Properly conceived and objectively pursued, such institutional 
aelt-atudv may possibly result in data that presents a cade 
against a popular cause. The researcher must be prepared to 
accept the tate of this eventuality. Also, he must not con- 
sider It a personal Rebuke if the president, or others, act 
contrary to, the direction his study supports. His . responsi- 
bility Is for research, and not for management decision- 
making, 

ConciTted and systematic efforts'to encourage the use of re- 
searcli are essential. To spread the word, some form of blanket cover- 
^age should J)e given to the findings o'f research studies. Where 
numbers warrant, a periodic instituMonal research letter can 
help to keep the IR dimension among the upper priorities of faculty/ 
management activities, 

Dne final aphorism: Haste makes waste. Most innovative programs 
In education, including IR programs, have been plagued by the tendency 
ot both observers and participants to want immediate, visible results. 
We suffer from the habit of pulling up the plant by its roots every 
tew months to see if It is alive and growiugl Resist that Anxious 
urge; set reasonable target dates and then patiently insist they not 
be tampered wlthl 
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INSTITUTIONAL RhiSEAKCH m) MiVNAC.EMllNT : THE ESSENTIAL PARTNERSHIP- 

Cheryl Opacinch 
Coordinator of Institutional Research 
CatoAsville Conununity College 
Catonsvi He , Maryland 

In thi} past, t\w r\)lt' uf institutional rest^arcfh has been to assist 
the col loge in goal achievement in a number of ways, including 
documenting e.nrollment patterns, assessing the effect of various teach- 
ing methods on student learning, projecting demand for new programs, 
and predicting the effect of those programs on campus resources. 

Todayi we are seeing a shift in our institutions' needs re- 
sulting from external pressures such as slower growth, more part- 
time adult students, diminished resources, additional state control, 
and, internal pressures such as collective bargaining, demands by 
faculty for meaningful participation in governance, and an increase 
in tile numher of students in need of developmental skills. 

The roles of administrators have altered dramatically over the 
IcisL U) to 15 years as have those, of institutional researchers. Today, 
responding to external and internal pressures, both institutional 
res^Mrchurs and i*n liege administrators are on the brink of perhaps the 
moat dramatic chan>;e of all: a shift fro.m research to planning and 
from administering to managing. The following chart shows the relation- 
slilp between various Institutional phases and the roles of adminis- • 
trators and institutional researchers: 



Institutional Phase 

phiMiomeiial growth, 
pltMitltuL resources 

slowed growth, 
adecjuate resources 

litt le growth, 
diminished resources 



Role of 
Administrato r 

building 



cont^emplaLlng, 
evaluating 

managing 



Role of 
Inbtitutlonal 
Researcher 

reporting 



researching 



planning 



The :to] lowing descriptions give a 'relatively detailed view 
ot the three tvpes of institutional research: 

te -^.^tiitii 'Itils kl,Kl Of researcl, is usually an initial response to ad- 
ministrators both on campus and at the stat€ and federal level that 
describes in rather limited terms what is occurring in higher edu- 
cation Institutions. The need for reporting has not abated, particu- 
lai-lv at the tederaL Level, and reuorts as well as their data 
elements ,aiul siibgroupings continue to proliferate. Reporting 
usual Iv requires the kind of information that is routinely collected. 

Kxamplcs of tl,ese reports are: the federal government's Higher 
Educ.itioii Coneral Infomation Surveys, student profiles, grade dis- 
trihutlnns, oiu-oilmenL reports, staff profiles, and facilities in- 
ventories. 

lii^vli:iili!Lati: Tl'l^ type of Institutional research lias been provided 
m response to administrators' and faculty members' desire to assess 
.iiul evattiate what tliev have been doing. This desire has apparently 
coiulnued (.0 ^r.-w: Wttn.vss tlie Increasing numbers of institutional 
research i-osUlons being created on community college campuses 
and the biir«eonlug number of documents added to tiie Kducational Re- 
sources InlormatMon i.enters system annually. 
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Examples ot* queBtions asked of researchers are: 



To what degree, , . 

are college goals being met? is the community served? 
are students satisfied with pheir college's pragramr 
and services? is their a relationship between pre- 
terr'ed learning styles of students and knowledge gained 
from a congruent teaching style? 

Is there a significant increase,,. 

In knowledge gained if group discussions supplement 
U'CturesV in the number of faculty favoring collective 
bargaining after class sizes have increased 20 per- 
cent and inflation has eliminated any salary increase? 
in the number of women students enrolled in programs' 
nontradit ional for them as a result of concerted 
publicity, counseling, and recruiting efforts? 



Planning ; I'ndoub t,edly, planning is done in response to the needs of 
administrators to allocate diminishing resources in the most efficient 
and productive manner. Planning builds upon the information collected 



f.or reporting and research purposes, but it does more than describe 
what has been. It can describe what will be and what will be "If," 
Thus, it it; concerned with analysis of the existing, simulation, and 
projection. It differs from reporting and research in that it deals 
with mote than the quantitative; it is concerned with the qualita- 
tive, policies, and philosophies. Planning seeks to facilitate se- 
lecting the best methods for achieving institutional objectives. 
Kxamp los of planning include: 



enrollment projections, facilities demand projection, 
torecasting needed programs or courses, establishing 
program eniTollment demand, and determining class size 
ratios and needed faculty based upon a proposed 
schedule. 



Planning asks qiu»?;tions such as: 



What if a calendar change were made? What is the 
probable effect on enrollment, efficiency, student 
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enrollment, needs of students who wish" to transfer, 
work load of affected administrative offices such as 
admissions, registration, public relations, and the 
I'omputer center? 

The Aj) 1 1 Lty to Manage 

The ability to plan, to manage, calls for new skills. What's needed 
ts the capacity to view the institution and it's goals objectively in 
order to 

• Identify institutional strengths to be built upon, and 
deficiencies. to be corrected; 

• conceptualize institutional parameters empirically; 

• be aware of available internal and external resources; 

• 'talk with' and 'to' computers; 

• ask the 'what if questions; and 

• implement the results of these analyses. 

F.ach of you could a^id to this list, but the major point is that 
we're seeing the scholar president of yesteryear, who has read ell the 
classics, now needing to read a computer printout; the president 
who coaceptualized a new way to analyze literature/ now needing to 
conceptualize institutional parameters; the administrator who hardly 
had time to ask "what are we doing?", now asking "how are we doing?" 
and also he>;inning to ask "how can t;e continue to do it?" The move 
from administering to managing is upon us; note, for example, the 
growing; number of presidents from fields such as business, who've docu- 
mtMitcd thotr ability to manage. 

What, then, is the researcher's role as the partnership con- 
tinues/ hi essence, it is to facilitate management— to plan. 
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The responslbillrtes will differ; they are dependent upon such 
factors an the stage of development of the institution, the willing- 
ness of campus personnel to become involved in developing computerized 
planning systems, tlie time administrators are willing to devote to 
the analysis of alternatives and their capability for conceptualizing 
institutional parameters, as well as their understanding of simu- 
lation and computers. ** 

la some instances |' the institutional researcher may need to teach 

/■ 

institutional planning, organize the development of planning models, 
analyze for presentation the results of simulation, or, in some in- 
stances, play an advocacy role for a single, alternative course of 
action. We liave not functioned in the planning-managing stage long 
enough to define with any degree of accuracy the primal^ role and 
responsibilities of Institutional researchers. Just as we bor- 
rowed frameworks from the disciplines to conduct our research, we 
must borrow and adop^ frameworks for planning fro\n each other, from 
business and industry, and from organizations that develop '*model'* 
frameworks . 

[ can't think of a more challenging, interesting, or stimula- 
ttn^ place to be professionally than in institutional research today. 
In five years, I hope we take the time to ' ook back fu see how our 
roles have developed. And, lest we feel r.hat any tiling is truly new 
or novel, 1 like to share with you a f ramewor'; I came across after 
l*d developed my tlunislits concerning tlie evolution of community col- 
leges and the role of institutional researchers and administrators* 



RKLATI.ONSHIP BETWEEN ORGANIZATIONAL PHASE AND 
TYPE OK INQUIRING SYSTEM'^ 



2. ptrtu-tlt)n 



3. DeLeKHtlun 



Type of Inquiring 

lhas« TvnPH of n.r^ System 

I. Cfeatlvltv pehsonai ohsHrv^^^rm Informal, Interpersonal, 

judgmental, synthesis, 
consensual; (Kantian or 
Hegelian ) 

add ; standard format 
reports of transactions; 
functional budgets; an- 
nual reports; some 
computerization 
(Lelbnltzlan) 

add; unit cost analysis; 
seeking comparative data 
on costs, workload and 
performance data; com- 
puters required 
( Lelbnltzlan) 

add; objectives ex- 
pressed as programs; 
PPBS attempted; simula- 
tion models to evaluate 
alternatives; prograiji 
cost analysis ; regular 
data exchange; exten- 
sive computerization 
(Kantian) 

add ; flexible output 
formats; e liminate 
standard rep.orts, PPBS, 
standard unit costs an- 
alyses; Integration of 
previous decisions with 
new IS design (Hegelian 
or Slngerla n) 

add_t mtMiis tlie II. ^ed characteristics are in addition to the char- 
acteristics listed above In the same column. 



4. Co-ordination 



Types of Da ta 

pehsonai observation , 
t'xpez It'nce, direct 
feedback 



acid; functional 
t ransact lons (ac- 
count ing, student 
records) 



add; ' more detailed 
transaction data by 
operating unit , 
sources and us^s of 
resources 



add ; standardized 
data elements 



Col Laborat ion 
(which mav 
t rails t orm 
to 2 or L) 



add: personal feed- 
back, process 
feedback 



^Weathersbv, Ceorge U. Decision paradigms and models for higher edu- 
caLioti. Paper presented at the Fnrtv-KlKhth NativMinl Meeting of the 
Institute I or Management Sciences and the Operations Research Society 
ot America, has Vegas, Nevada, November 1975, 
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The prectullny, chart is taken, from a presentation made by 
(leor^o WiMtht»rsby ot Harvard's Graduate School of Education, Insti- 
tutional' development is defined in five phases, and types of data 
ahd inqulrv systems tvpioal of each phase are defined* 

I think Weathersby\s chart provides an excellent framework 
In which to document chanj^es in institutional researchers roles, 
and L hope vuu find it useful for documenting role changes. 
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AN ORGANIZATIONAL PERSPECTIVE 
ON INSTITUTIONAL RESEARCH IN TTiE EIGHTIES 



Ervin L. Harlacher 
Chancellor 
The Metropolitan Community Colle^jes 
Kansas, City^ Missouri 

I am pli.^ased to be here today among many of my frit^nds and former 
coUeatuou. L am reminded ot the plight of the conventional institu- 
tional researcher when I think of the s.tory told many years ago by 
one PatrLck Hoo Ley when he was asked what America had done for the 
working man: 

"Well," he said, "when I first arrived in America, a green- 
horn from the Ould Sod, tht.- only job of work I could get was with the 
White Wings, New York City's street cleaning department. Then it was 
'Hooley, do this; Uooley, do that/ And afler a bit, because I'd worked 
riard and done my job well, someone a«ked me to run for boSvS of the • 
local union. 1 did that, and I was elected. Then it w^s ' Mister 
Hoo lev, sir' — and sometimes ' Mist er Hooley darlin'." 

"A liw years later I was asked to run for alderman — which I did 
.Hul was elected. Then it was ' Hono r able Mister Hooley.' And pretty 
soon I was made chairman of the Boiird of Aldermen, and then, of 
course, they calUd me 'Mister President . ' But it wasn't until a visit 
to the Ould Sod once again that I realized how America had elevated the 
working man. j 

"it was a beautiful Sunday morning and, with my handsome young' 
niece on mv «inn, I mounted the marble steps of the Cathedral. As I 



pushed open the fln^j wooden doors'and stepped inside, the choir be- 
gan to sing, *Hooley, Hooley, Hoolev*..* 

^ "ThtitVs.what America has done for the working manl'* 

In order for us to have a perspective on institutional research 
*n the 1980s, we must first determine where institutional research 
t\t8 into a college's governance and management systems. Like Hooley , 
the ins'^^ltut lonal researcher in the modem community college may 
have an unreal impression of his importance or aow he is perceived by 
his peers. For whether we like it or not, the best data in the world, 
circulatt»d aanionafl^ , will go unused if it is not merged with the 
decision-making process in a politically astute way. 

My purpose today, chen, is to share with you: (1) a management 
stem based on goal setting and evaluation which utilizes institu- 
tional research (not as an end, but-ratlier as the means to an end) • 
in ( nst itiit ionai problem solving; (2) a system of organizational rela- 
tionships in which institutional ^'-search and planning can become the 
decisive factor in effective governance. ^ 

But before describing these systems, I'd like to make a few 
personal comments with respe:t to the governance and management 
of multi-unit community college districts, 

Prior to leaving this area (New Jersey) three years ago, I 
would trcqueiitly hear the question asked: Is New York governable? I 
guess we nw know the answer to that question, Thos jf us in 
multi-college districts now frequently raise that question with re- 
spect* to our own districts. 
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since movluK to Kansas City, I've had occasion to ask myself how 
anyone can govern In a rational manner so complex an empire as this 
one: A Hlxty-yoar-oUl system servloR tlie one million plus residents 
of lUv tour Missouri counties oi Metropolitan Kansas City through 
tour colleges (three with formal campuses): Penn Valley Community 
Co liege, lucated near the District offices in midtown Kansas City; 
hongvlew Community College, 20 miles to the south; and Maple Woods 
Community College, 20 miles to the north; and a fourth college, Pio- 
neer Community College, that utilizes sites tl^roughout the four-county 
area. These four co lleges--each with Its own name, its own president. 
Its own distinctive characteristics, and its own hallmark—enroll more 
tlian 2S,()00 students. 

Frankly, the challenge of managing this dynamic and complex 
system of colleges has rekindled my. interest in institutional research 
and p 1 annlng, 

WIjv? because in mv judgment management control must exist in 
all organUathMis if ihey are to achieve their mission. The question, 
then, is: we want thv control point to be at the management 

activity \vvk>\ or at tlie outcomes 1 (^ve I ? Are we interested in con- 
tr.illlug activities or results? 

Tills dellboratlon has led to the concept of accountability. And 
accountahl 1 Itv Implies the setting of goals and evaluation of out- 
comes and the neeil for data to set and measure them, 

C(wernance, according to .Inhn H. Millet, Is both a structure 
and a process that characterizes every social unit, implicitly or ex- 
plicit Iv, In educational institutions, a dual structure usually 
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exists: lino for decLshm making about tht administrative or ins titu* 
tional aMairsof a college, and another for the academic or lastruc- 
t^louajat t airs. In t'w tlrst Instance, the board of trustees, the 
president, and the admlnlstrat Lve stalt form the group that is pre- 
occupied with iast Ltut Li)nal affairs; in the second instance, it is 
the taculty Chat are preoccupied with Instructional objectives. In- 
structional procedures, taculty selection and promotion, student 
actidemii' performance, and the fultlllment of degree requirements. 

Historically, these two structures—Institutional and instruc- 
tional — have been in conflict, though the need for such conflict 
remains obscure, However, we generally attempt to avoid the conflict 
through a form o( governance called the community governance 
modi- 1, which attempts tu bring together in one body representatives 
ut the taculty, stafi', srudents, and administration. 

This model has met with limited success, and is highly suspect in 
an environment bf collective bargaining. (Some would say it leads to 
collective bargaining.) For this reason, a new king of institutional 
leadership may emerge that will require much more extensive information 
sluirluK, !m>ri» ltMiv;thv consu I t,U Ion, and more emphasis on goal setting and 
the measurement o! results or outcomes of the decision process than the 
community governance model descriluHl above. 

Peter Dnick'i*,* in his book The Age of Pis con t inui ty , -stresses 
the importance ot inform.ition sliaring, goal setting, and evaluation to 
organ izaL Lonal health: 



The members of organizations, whether employees or stu- 
de)its, ^^llOllld be expect chI t(J tnkc the largest possible 



^nrm-VerV Teter, Uhe a^ e of' disco tainuity . New York: Harper and 
Row, 



ERLC 




ERIC 



respimalbi llty tor managing the community life of their 
Institutions'. A great deal of what managemtnta are doing 
today Is not relatud to performance and function. Why man- 
anement should run the plant cafeteria, for instance, or 
bo ooiK-erned with maintaining student diacipllne, is not 
very clear. And there are many other areas where community 
se l t-goveniment cf>'i and should take over. 

Altogether a wise management does not speak of "manage- 
ment prL.ro.v.rlvo.s." It does not even think of them. It 
limits Itselt to the spheres of direct relevance to its cen- 
tral task. F-ervthlng else It tries to unload. Wherever even 
serious malfunction would not endanger the attainment of the 
orsanlzat Ion's objective—student discipline is an example— 
tho wise executive says, "Tliis Is your Job." 

U Is also highly desirable to bring these "members" of 
organization as far as possible into the decision-making pro- 
cess, iitherwlse they cannot acquire any understanding of the 
realities of their Institution. . .Without such understanding 
organization Is always endangered. And we know that partici- 
pation In the actual decision-making process is the only way 
to acquire the rudiments of understanding... 

Bur In the areas that directly affect standards, per- 
Lormance, and results of the institution, the members 
cannot take over. There, the standards, the performance, 
and tlie results must rule them.,, 

(irganizational leadership, then, according to Drucker, re- 
quires part iLloat ion by members of the organization for informa- 
tion-sharing purposes, but the authority to set. goals and standards 
and to control Llie means of evaluation must not be delegated down- 
ward Dv top m.ni.igemeiu . 

These words h.ive important implications for institutional re- 
search. II we .iiT going to place more emphasis on Information sharing, 
our information must be timCly and accurate. And, If we are going 
to sft goals and evaluate results, then we must know not only what 
results we ate seeking i)Ut also how to measure the outcomes, These 
concerns lead me to suggest a management model for tiie 1980s that 
makes institutional research the keystone In the decision-making proceaa. 



S Imp I IsC If.al ly , the management model I propose Is one that would 
allow deelslona Lo be made on the baa la of the evaluations of prede- 
termined, mutually agreed to goals. That Is, the board of trustees 
and the chaiu-ellur ov president and his or her immediate staff should 
be primarily concerned with goal setting and evaluation, not man- 
agement activities; Where do we want to go? (What are our goals 
and objectives?) And Jid we get there? (How well are we accomplishing 
our goals and objectives?) Middle* management should be concerned with 
reaching the goals and those activities which move them toward those 
goals, and Institutional research should provide the data and infor- 
mation to set the goals and then be responsible for measuring to 
det Tuine whether the goals have been met — that is, evaluation of 
how eli the institution has done, 

A management model of this type is best driven by a Management by 
Objectives system, requiring the development of annual management 
objectives that are consistent with annual priorities and a system- 
wide master plan. 

An HB(i system distinguishes between conformity and freedom — 
contormity to goals and objectives that have been agreed upon in 
advance, but freedom in clioosing the means for achieving those 
objectives. 

t.et's locus on the goal-sett J ng process for a moment. It is 
essential for colleges to articulate their mission, goals, and 
objectives iinL only Lo assure that they will become a part of a 
management svstem, hut also: 
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...to «ivu iltrectluu to present and future work 

...to provide an tdeoloRy that can nurture internal cooperation 
c-ommunli-at lt)n, and Crust * 

...to i-nablf appraisal of the Institution as a means-end system, 
.ind • 

...to ailord .1 hasLs for puhli.i understanding and support. 

As I've HUKsested, institutional ^ual determination also in- 
volves the estahlishmtMit of priorities. As Peterson has .said, "an 
Institution's ',;o.il s tru.- ture ' -its rank-ordering of goals-can be 
snld to he determined when some level of consensus has been reached 
tlirouKli a process that Is democratic and participatory." Similarly, 
Schoor pointed out that the goal determination process must be re- 
Karded universally througligut tlie district as fair if the resulting ' 
goal structure Is to have legit Imacy— that is. If ' t; is to be 
accepted as appropriate In the college community. 

institutional goals are best conceived of in terms of outcome 
g<.als and support goals, outcome goals are the ends the colleges 
seek; thus, thev expr-'ss the desired educational productivity. 

Support Koals are tlu- go.ils that facilitate reaching the out- 
coiiu' goals. Thev l,ave to do with Instructional resources, educational 
e.ivl lonmout , research and development, and so forth. Accomplishment 
ol support gnals Is Intended to optimize the prevlo*isly identified 
outcome ^oals, 

dace outcome goals and support goals are determined, a neces- 
sary next task Is to tr.inslate tiiese conceptions into precise, mea- 
Kui-eahU- program ob|..ctlves. Tills procss requires good insHtutlonal 
research , 
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Kvaluation 

The otliLT hall' ol thin equation Is evaluation, Evaluation has at least 
two deslrcJ c»utt'omes; (I) to document movement toward objective 
achievement; and (2.) to provide data tor subsequent decision making. 

It is essential, however, for systeri participants to feel that 
the evaluation Is worthwhile; th^t Is, the activities carried out in 

« 

the evaluatltjn must be seen as useful to those participants to whom 
the evaluation applies. Tlios, lf the participants feel ownership and 
believe that the evaluative activity will be beneficial, it is much 
less likely that either the evaluation objectives, methods, and pro- 
cedures or the value of the results v»ill be questioned. This kind of 
acct'ptance Is critical to a mantigement model based on goal setting 
and evaluatlun, 

A second major objective of the evaluation process is to document 
the extent to which objectives are achieved. Wherever an inquiry is 
made, tiie function of eval ition Is to provide evidence of the level 
at which objectives are achieved. From these data, decisions c«n then 



Within the Metropolitan Community Colleges, we have organized 
ourselves into a pattern which we think supports the concept of 
leadership through the setting of goals and the subsequent evalua- 
tion ^ ot >;oal achievement. 

While we are a multi-college district with a central chancellor's 
office and somewhat autonomous colleges, what I am tibout to describe 
can work )ust as well in a single college If the presldentVq office 
atul 'italt are put in the same context as a "district office" in a 
mul L i -co 1 lege svsLem, 



be made. 
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The MotropolUan Community Collt»ges emphasize functional manage- 
ment based on tlit» concept of decision making relating to the differ-, 
entlatlon ot hinctluns between the - ol leges and the chancellor's office, 

U (s the dl.strlctVs respons Ih ( 1 I ty to provide an overall, compre- 
hensive program of education and services suitable for all segments of 
the district population and to assure that these offerings are effec- 
tive in meeting individual and community needs. The' colleges , on the 
other hand, have the responsibility of developing and operating all 
educational programs and services in their service areas. 

Accordingly, decisions are made at the district level when: (a) 
the proposed actl.on or Implied result of the decision requires either 
the board's or the chancellor's approval; (b) the decision requires 
total di?;trlct resources to Implement; (c) the decision is related 
to the legal responsibilities of the district; or (d) the decision 
would yield efficiencies through system-wide implementation (for ex- 
amplts a d^'cLsion to make use of a single computer). All other de- 
cisions are m<ide at the college level, 

rn operating the district, the key resp'onsibilities for each 
management element are: 

h'or the chancellor (as chief executive officer of the board) 

1. *oal setting for the district, in accordance with the 
•on-vtMi* master plan; 

Kvaluation ot all programs and services; 

3. I)<»ve lopmeiit of new programs and services (district-wide); 

V. Comniunftv and governmental relations (district-wide); 

iVrt iln centralized support services for the consortium of 
CO 1 h |^es ; 
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Kstal) llshmunt oi district-wide pertormance standards and 
systems Ln areas • ueh as plant operations and maintenance, 
HL'L'urlty and salety, tLnanclal aid, Information systems, 
pro>i;r,im review processes, internal audits, and communi- 
iM t Lons sys t ems , 

l''nr t'vieh president 

I, riie operation o\ ail educational programs and services; 

J. iKWil set tiny; tor the college; 

J. Kvaluatlon ot the r each! ng/ learning process; 

4. Support services tor college departments. 

There are sLmllarLtLes between our organization pattern and a 
leileral system, in which a territorially diversified pattern calls for 
two levels of government — one to deal with the common, the other to 
deal with the territorially diverse, Perhaps our greatest challenge 
lies Ln our ahillty to toster diversity, creativity, and Initiative 
on tlu» part ot our locvil colleges and, at the same time, to guarantee 
excel leiu-e ot programs and services offered by each college in a cost- 
ettectlve manner wltluuit unnecessary dapllcation of effort, These 
respons Ih 1 1 1 1 i e^^ welded together In a process of accountability, 
decision making, evaluation, and adequate staff support should pro- 
vide the district with eft'ectlve management for the future, 

J^Ji-^ ^^^^ ^'^^ 'iil^ ^'..iLi 'il 

Where do we tit Institutional research into this system? At the dis- 
trict level, we have three support divisions: one concerned with 
tlscal and personnel m.itters, one concerned with public affairs, and 
one concerned wUli goal setting and evaluation. These divisions are 
he.ided bv vice chancellors who report to me. The divisions are staff 
oriented and hav(» no line authority over th(» colleges. 
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Th. divlsloa that is concerned with goal setting and evaluation 
is also rospuasibU. for our central computer services, the develop- 
ment of manase„u.nt systems, curriculum planning and coordination, long- 
rau«e plauntug, and research and aualysis. a service that is available 
for all other tunctiuns ot the division. All data reporting about the 
district, both internal and .xternai. flows through this office. 
K.Hoarch and ..nalvslH program audit, and evaluation, base data for 
Koal setting, position papers, projections, and master planning are 
latogral to the n.isslon of research and analysis in our system. 
The fundamental role of this goal-setting and evaluation di- 
vision is. first, to provide management with the data, alternatives, 
systems and standards, and tools necessary for effective decision 
making; second, to monitor the results in terms of the achievement 
of the goals set forth; and, third, to provide a master plan for 
the luturr in ail areas of district activities. 

Tht. division, then, has a tremendous responsibility and a 
great impact on our district. We feel it is the link that .nakes ef- 
fective, management by goal setting and evaluation possible. The 
status o, this division has grown, and its acceptance has been 
_ fostered throughout the district because the data it reports, the 
planning U does, the evaluation It makeo, the recommendations it 
prepares, and the svstoms it develops are used. The single most 
Important cloment In tla- manngemen' scheme I have just described is 
the Intent to make ,ull use of the products of research. You caa- 
"ot organize in one manner and operate in anotlier. 
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Hven though you are not organized in the manner we are» or may 

never be, there still are critical questions that need to be answered 

now and into the 1480s to help support the decision-making process at 

your t'u I le^e. For exMup le : 

How many ot you can supply your president witli cost effective 
data tor the programs otfered at your institution? 

How many of you can supply your president with accurate historica l 
data on the operational and Linancial aspects of your 
t'edoralJy assisted programs? 

How many ot your Institutions have a specific set of measurable 
oh )t»c 1 1 vus? 

How many ot you have a usable master plan for the futate? 

How many ol you have an ev aluation plan to measure your college's 
e 1 1 ec' t iveness in meeting its mission? 

Hverv conference 1 attend and every educational publication I 
read extols the virtues ot accountability, cost effectiveness, simu- 
lation models, long-term legislative agreements, and performance 
indices and encourages educational administrators to think in these 
terms • 

11 wo* re not concerned with them, then nobody is. Yet if we 
are, are tluv iised? The responsibility Is shared. The ins tutut ional 
resecircli must be done in a timelv and accurate manner, and then 
Other administrators and I must use the products you have generated. ^ 
If we do not use them, you'll fall into disuse and we'll be ineffec- 
tive m.in.igers, 

I believe wo have tlie tools, tlie computu-r models, and the con- 
cepts that ill low us to measure the progress and process of our past 
derisions and provide ourselves with decision-making data for the 
tnturo. However, 1 question whether we are making adequate use of 



thene Cools hi today^s problem-solving and managerial techniques. 
One ot tlie must ImportariL things we must have in the 1980s is a full 
complement ot nidnaKement tools to support the decls lon--making process 
and we must bo committed to using them. 

Perhaps that statement sounds so stale to you that you can hardly 
believe that someone is actually saying it again. But let me tell you 
why I am saying it again. It this were August 1966 rather than August 
I97b, and we were aiti^mptlng to look at the 1970s, how many of us 
would liave beon able to identify the following challenges, which we 



now face 


in tlie ltJ7<^': 


a. 


declining full-time enrollments 


b. 


emergence ot the "nontraditional" stud-nt 


c , 


average student age of 30 




resistant legislative bodies 


e , 


severe budget constraints 


\ , 


laculty lavoffs 




CO I lec t ive bargain ing 


lu 


l»igli unemployment 


i. 


increased interest in vocational/technical training 



I could go oil witli tlie litany oL education problems we are now 
facing that were not predicted, hut it is not necessary. What is 
iK^cesstirv is lor al 1 oi us to see that accurate data and effective 
loug-range planning, are crucial to decision-making. Tlierefore, I 
sav to vou, develop the management tools that will carry you into 
the M^SDs, It the tools that liave hacn developed work, use them, 
It thev don't work, dispose ot them and develop tools that will 
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work. Always be cognizant of the fact that you are in a dynamic 
environment, and as you initiate change, make sure that your tools 
are flexible; enough to accommodate that change* 

Finally, we often promote the concept of institutional research 
and planning services tor dacision making; yet we en-i up making de- 
cisions based on "our years of experience," This technique of manage- 
ment always deals an effective deatli blow to research and planning 
services. If we are to organize for the 1980s to avoid decision making 
based on what Simon has called "little more than ambiguous and mu- 
tvialLv contradictory proverbs," the need for institutional research 
to play a strong role Is evident. And it clearly must play a decisive 
role within organizational structures that is based on goal setting 
and evaluation. 




ibiiNTIFYlNG INSTITUTIONAL 
RESEARCH NEEDS 

Leslie Myloa ^ 
Director of Research and bovclopment 
Delta College 
University Center, Michigan 

Ll. i.H crltUal to Institutional research, ^^t it is going to be used, 
to dvUnv sharply what it is, who it is for, and what it is for. Con- 
tinuous reevaluation within our own institutions is necessary if w^ 
are to avoid the "shelf-decoration syndrome," the institutional re- 
searcUiir's nightifiare ul the results of his perception and genius 
dtH'uratln^; thv shelves ot his and other offices rather than being u^d. 
U we are in >;ood conimunicati6n within our institutions about what in- 
stitutional research is, who its clients are, what the objectives of 
the research act^, and how the objectives of institutional research are 
related to t\w. ^oa Is and objectives of the institution, the client 
groups ot the Institution, and the client groups of the institutional 
researcher, we vlJl have taken a Long'step toward producing research 
that will be used. 

LdcntHylnK^ resuareh needs, then, is critical to the whole enter- 
prise. Ln order to Iduntity institutional research needs, it is nec- 
i-'ssary to: * • 

deLiiu» InstUutlonai research 

dc't Inc tht» clients tor Institutional research 

Identity Lhelr ohJectl\es, usually in terms of their clients 

dctiue Wiivs ot coRunuuicating eftectively with clients Ln 

order to mvvi their institutional research needs. 
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What Is InHLltut luuaL Rusearrii? . 

KliaL, wh.it Lh iiisL LLul Lunal reHcarch? The answer is stLl i being for- 
muLaled, The l^h4 ALR (Assise Lat Lun lor Inst Ltut Loiuil Rt-iuarch) Forum 
was tievoLi'ii to clove iDpnitiiL ot a i!oiu:eptuaJ framework for institutional 
researrli, whlrh lii 1964 was a very new luuction even in many major 
universities, valuable perspee.tive on ins '.onai researeh as an 

emerHln^; pro^eK^Jll)^ eau be Kained from reviewing the prjceedings of 
^ that luruni, 

. l)ol(l^) coimnenling nw ''['he Role ot Institutional Research in the 
Admlillstrative Process'* in that forum, slated five propositions as a 
b«»sis tor «i roneepLual framework for fnst , ' nal research: 1) the 
eviWutlon ol institut iens i)f higher educc ton f r* i small, relatively 
simple fnsUtutiDns to large-scale, complex i rg itiizan ions essentially 
bureaucrlit Lc In st riK.ture and mode ot operation; 2) the emergence rf 
a new sLyU- ot admin itit rat ion he characterized as "scientific;" 3) the 
evoluLlon i>l lust ItuL lonal rese,;rch from sporadic studies and collec- 
tliMis oi ilat ' to roordluated systematic conduct of studies needed for 
iufJt 1 1 nt lun.» 1 ImprDvemenl; 4) the emergence of institutional research 
special ists; and ^)) the pro f e.... t unali;5at ion of those specialists. Con- 
lertH's at the furnm agreed with Uoi that institutional research is a 
St. II I, iu>t a line, luucttjii, that It should be used in the evaluation 
i>t policy, aiKl that It should not formulate or implement policy, Tfiey 
were In ci>ns I derah le disa>^reement , hi)we\'er, about tlie place and role of 
Institutional research within ttie Institutional hierarchy, t>ie r-^imary 
populations It shoulil serve, the kinds of research to be performed, the 
manner In which research should be performed, and the manner In whicli 
tiie use ol resiMri'h Is suggested by IR personnel to others. 





Carrotlu^rsd) , I'residtitit ui the Uiiivt-rsity of CalKary, in a key- 
iior.o tipi'i't^h to Llu' M)7i Korum oi lIio Association tor luHLituLional 
Ki'SiMiL-li, staLi'd tluiL insL LtuLioiial ruHuarc hers are not policy makers 
or imp Umir'h tors hut saLd Chat Lhoir roLu is crur.ial la pulley formation, 
lit' u'L's lusLltui Loual Ti-seareli In Llic 19708 playing a major part in 
rt'lnloreliiK the work ot Lliose who are eliar^ed with developinn ^^^^ ef- 
IfeLLve pLaunui^ LnLeriaee between governments and nnlversiti.es. He 
sees new needs tor ins L i tut ionai research beyond providing planning and 
manaKoment int ormat Lon servLees, These include the nt^t, ? to provide 
tacts riiat are above reproach as a basis for collective bargaining, 
the need to [)rovLde Inl or.uat ton abont the eduealional marketplace in 
thi- eontext ot the open university, the need to make management devel- 
opment ^;y:.Lems des Limned by consul tants relevant to the university, and 
tiu* need to develop and coordinate management information systems with 
othei Lnst Ltut Ions ami or^anUat tons, Carrothers sees the major role 
of Lust Uut (onaL research in the applicatLon of rationality to manage- 
ment and In the nnders tand ln>; of the LLmitatlons of rationality — 
institutional research must not all."V the qnantif leation of the 
uncpaant 1 1 iab I c . Institutional researeh, according to CarrotheM'S, 
is the new baiter* between universities and tiie .siilfting forces of 
pol it Ic'i, 

Klbbei'(''0 took this coneepi a step further. in "The Hazards of 
l*lann(n>: ~ lyediciing Tubllc Polley," he said that Institutional re- 
seari-hcrs must wot taUy aet as buffers but that they must also predict 
pui)lic policy that Is likely to affect their Institutions. 

In l^>/^3, Hig ibotham and NetllCO* in a survey of Michigan com- 
munity colli»ge i)ri»sldents for tiie Michigan Community College 
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Aasol' lilt Ion lor l)t?vt? Lopmcnt diid Kiesearuh, askeu the prt'sidtuiLH • con- 
cepts ot iujJt lUiL I una L roseari'lu Tlu»lr rospousus and ttu* concupts to 
whli-h t.hoy wvrv respoiKling <ire shuwii in Table 1 , 

TABl.K I 

HKl.UW ARK FOUK DIKFEKKNT CONCKFTS UF INSTITUTIONAL RKSKARCH 

rVFlCALLY HKl.D BY I NDI.V lUUAUS . 

p 

WHICH a)Ni:KFT MOST CLOSFL^ COINCIDES WilH YOURS? 

Lnst i tul iuna L research Is the routine eoilection and 
tabulation ot data. These data may ur may nut be u:)ed 
Ln study particular problems or practices of the 
insL itut ion. 

V).2Z Institutional rt-seareh is the continuous investigation 
iir.d diita collection needed tor administrative de- 
eislcni making (i.e., budnetary analysis, space utili- 
zation s tud it'S , enrul ImenL pro J ect ions) . 

4/.0:':; Institutional research i:; the continuing selt'-study of 
all phases ot institutional operations (i,e*, all sub- 
ject iiuutcr areas of the institutional program, in- 
stitutional or>;aniziM ion, clientele, personnel). 

17 J-iZ Institutional research is the long-range pJanning, 

goals/objective setting and evahlation process for all 
phases of institutional operations, 

i)tlu»r 

No opinion 

I'otal 9^).H;' 
N (17) 



Fi'om this very i'ui'S( rv overview ol recent viewpoints on the con- 
cept ot institutional research, it can be seen that most intelligent 
obMerviM's have moved away t roin tlie concept of simple data gathering 
and tabulation towani the coni-i»pt ol liifititut iona I self-study, and are 
pLiiclng Increasing emphasis on the role of institutional research in: 

• po 1 i cy to rma t ion 



• goals and objectives 




• I'.valuat lr)u sett liiK, and 

• i f\8t UuL iona L piamiln^* 
UotiniiiK (MU-uts tor 1 nst Uut huuii He8t>arch 

Ah a starting point for discussion at this conference, "I would 
.1 Ikr ti) HUKK^-si that although our Instltutluna may differ, the most 
i'tteciLvo way wc lan assist our clients within the institution is to 
work with Lhein Lo Identity their client groups, the objectives and 
Roals ot those groups, and determine how the progress of their insti- 
t\itlons Lowanl those the oblectives and goals can most effectively be 
measured. Keeping In touch wlih the college's client groups and their 
goals and objectives Is the essence of planning for community-based 
edncallun. Keeping In touch with progress toward meeting those objec- 
tives Is the essence ot" accountability or productivity or zero-based 
h\ulgetlng, or whatever other phase you are currently using for knowing 
wile re you stand. 

It wc as Institutional researchers gan identify the college's 
[uiteiitlal clients and tlieir objectives, tlien we can assist in defining 
the guals and objorLlves tor the college, help our clients within the 
college to i.^Mitlty research Information they need, and establish a 
basis [or Ident living college goals and objectives, setting college 
polU-y, and Ident Hying planning needs. Potential clients of the col- 
lege can he Identified lor cacli institution and will vary by institu- 
tloiu Some suggested groups might fall Into the icvl lowing kinds of 
iMl egi M 1 : 



>t r)U (ill. iUwl{'>iin) 



h I gli ijchoo I students 



working pi»ople 
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protessLuiuils 
blut» col Lar worker^ 
sa U»s/servlL'f workers 
[)t»opU' at. humo 

WDIllLM) 

p Ivlf r i^tTSon.s 

ri't I vvi\ persons « 
■ vo'.n'i^ ehi IclrtM) j 
iiDLMup 1 uyt d pt; rsons 
h.md Lc ipped pur sons 
LnsL Itut Lona L Izod poraons 
jail LnnkiLt's 

persons In nursing homes 

hiis ( nosses 

eontraet proKrams ^ 

rooperat Lve programs 

omp 1 ove rs o t graduates 
Indus t r l ev 

I'oiU rar I prugranu' 

rooper,u i ve p roKi'^^"*-"^ 

eiiip I oye rs ot graduates 
gove rntnenLs 

I'oni raet programs 

iMHjpoLMt i ve programs 

employers of graduates 



1" is^ 



labi)r unions 



iippreni Lcoshlp programs 



cowl VAct prL»grama 



loca 1 Iml Ivuduai taxpayery 



local buslnoMaes and Industries 



V 



state M^wernmenL 
ffderaL K^vernment 

business/ proi'esslonai organizations 
t oundat Lous 

This is hardly an exhaustive list, and, of course, many of its 
groups overlap, but the point of U is to start with those for whom the 
hasle mission ol the Institution Is service. If the groups the insti- 
lut. Ion Identities as its priority service groups can be readied and 
thi-ir objectives ideutitled. this will be an exeeiicnt starting point 
tor ilet. inlng the ebjectlves of the institution and its programs. Once 
Lhe inst i tul Ion*s object Lves are defined, the base is estabiished for 
tiuollior important institutional, researcli activity — evaluation of 
pri»gress {\\ ineetltig vW)iectives, 

Dot i Miny, lust ( Uit lonal rolLcy, (ioals, and Objectives 

ll von a^ an Institutional researcli officer are able to assist the 

administrative stat I , tacnlty, and students in your institution in de- 



thi' relationship between objectives ot their client groups and their 
own proy.i ini^ ob )l»c t ives, von will f ind that you are in the process of 
a«> isl hu; In t lu» ili»t iiiit ion of institutional policy, goals, and 



lining the gionps they serve, the objectives tliose groups have, and 
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riiLs lunnat should bv understood as a conceptual trainework for 
det InliiK Lnst LtuLlonai resLv.^ch needs rather than as the firHt project 
au inatltutioual research ottLcer should undertake for his institution. 
TPie state ot the art ot tdeutliylng the objectives ot' a coLIcku's po- 
tential t [Lent ►groups is in Lts intaney*. Even Lt It were advanced, the 
•compU't Ion oi a research et tort which would identity alJ the potential 
client KToups ot an Institution, their objectives, the institutional 
object Ives which lollow t rom those, the measurements which will eval- 
uate pro^;re.s*^ toward meetLn>; those objectives, and so on, would be a 
massive undertaking; requiring; an army of researchers. 

Some Institutions ^ny own included), however, have made some pre- 
liminary -tlorts toward identityluK t^tich a conceptual framework* With 
the ass l.«. r.ance o} an Advanced Institutional Development Grant, we have 
been abie to complete a coitmiunlty needs analysis and an Institutional 
►;oal^i liwentt^ry usin^; the Institutional Coals inventory developed by 
Richard Peterson ot Educational Testing Service (ETS) , 

lit May 1^)7), l)elt.\ Colle^^e Senate President Owen Homeister ap- 

l)o luted a (:oUeiL;e tloals Committee with the following charge: 

I, Prepare vi set ot Institutional goals and a mission statement 
tor cons 1 dervit ion and adoption by the Delta Senati* and Hoard 
ot Trustees by July l, 1976, 

.!, Idi-ntlly those go.ils that shtiuld be .given priority tluring the 
next 1-') years , 



*At the I9;b AKR/\ Ain\ual Meeting, a paper presented by lielle Ruth Wilkin 
ol thi» Al.nni'da Comity, CaU.lorni.i Office of the Superintendent of 
Schools imU Itled "NoimIs Assessment Models: A Critical Analysis'' con- 
cludeil that t ew motlels have beeti validated cUid that many in wide use 
employ overslmp 1 1 1 led metlunls iOr identifying discrepancies and levels 
ol critlcalllv an^l tor set ting priorit les for action. 



Sliu-t' the comiiiLLtiH^ waH to deal with inHtitutionai Koals, it was 
imporLaat m.i un L y have broad rupreHtMUat ion but also a c.ummlttee of 
rtMsoiiabLc slzo, Ihc iDlhiwliiK apjiu 1 'itments appeared to aatlsfy both 
rt'ipil ri'inoius; 

Mai jurLi^ hi^i'smi, Clia Lrporsun , Prufi'saur ot Business 
ILil Annan, Assistant to tlu* PffsLdent 
Hnu'f CoriLss, I'l-oti-ssur oi Ctudu^y 

Koii L'rosiiLand, As.^jiu- iate Llean t or Coiiuiiunity Education 

(l<« WLt»land - Altt»rnate) 
.U»ssi.i» DoLson, AssLsiant rrut'ussur ut Nursing 
Sanndra loriis, C.onnselor 

Don Halo^, AsKLsLant I'rotcssur uf English 
KLi'hard KU-Ln, Social Science Division Chairman 
Leonard MarsLeu, television produeer/director 
Ralph MiCivern, Associate I'rotessor of Architecture 
Willir Thompson, Ae.idemLe and Student Affairs, Administrative 
A.ss Istant 

Ktrharil Wirt^.. Associate Director of Admissions 

Krsonree I'ersons; Don LauKhner, AIDP Coordinator 

Leslie Myles, Director of Research and 

Development 
Cone Packwood, Research Associate 

I'he KTS Inst itiiL lonal Coals Inventory was administered to several 
groups durlu^' September L^J74. AIL members of the faculty, administra- 
t Ion, anvl lioard ot Iriistees '/ere sent questionnaires while other groups 
Wi-re sampled* Results were tabulated separately lor each of the follow- 
ing; >;roups: 



^'^•^Hip Number of Respondents 

Hoa tlI ot LrnsLoi's 7 
/\dmin 1st ra t ion 4^ 
Kacnlty (full-tJme) I33 
KacuLly, Commiuiity and C<uitinuInK 

KduCtU Ion 36 
Students (academic , ot^-campus) 236 
Sluiienls, Area Centm; 

Students, (\)mmunity Kducatlon 96 
A second major source of Input was the Residents Learning inter- 
ests Survey. I'he L.arninK Survey had Iwo major parts: 1) a survey 
ot 1,500 trl-county households, and 2) a survey of Delta students. 
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RospiMises wt»rt» rtnoLvfd t rom approximate Ly 60 percent ot the households 
with a tutaL ot mure t!um 1,600 individual responses, A HlightLy al- 
tered form u! thi' same fiuey t lonnalre was administered to more than 500 
studi'nts, on and ot'l rampus. 

Additional sources ot int o r.mat Lou included the Student Reactions 
to Col ley,*? Survey, the L97 3 North Central Accreditation Report, and the 
consulting; survlces oi Dr. James Nelson, Michigan State University, 
and lU*. James H.irvey, McMauls Associates, Inc. ^ 
Formulation ol the Coals 

Be>;LnuLnH on May J8, 1975, when the committee first met, the process of 
writing; the go.iis went through tliree .'5ta>;eB, eventually concluding in 
Mtirch 1^)7^) when the >;oa Is were submitted to the Assembly in the form of 
a tjuest ionna 1 re . 

Sta>;e \ : 0\\ May 28 and June 4, the committee was given the infor- 
mation alriMdy described In this report. On the first date, the com- 
mittee's char^i* was explained to the members. 

I.eeson appo^nted a suhcommittoo (Ha log, Arman, McGlvern) to prepare a 

new mission statement proposal. In addition, the committee was divided 

into four subcommittees: 

I. Arm.ui, Torns, and Wlrt^ (clia IriuTson) 
2» Ci>rllss, Ha lug, and Mc(;ivcrn (chairperson) 
J, Rio In, Marslco, tUid Tliompson (clia Irperson) 
ClrossLnid, Ui^lson (chairperson), and hceson 

On June 11, each subcommittee was assigned specific goal areas 

from the ins t Itul i ona L (Joals Inventory and asked to consider, in terms 

of the college's nei»ds and situation, specific goals for Delta. The 

3ubconunltti»es were asked to be ready to report their recommendations to 





lull eonuiiUtA'L- l)y SyptumbtT. On Junu 18, the miaaion statement 

SlaKt;Jj^ Fropi Suptt'iubor Lo November, a serLus of wurkshup ses- 
stuiKs In u'vlew the sub /ommlUee report.H took place, Un Septomher 11, 
.1 toniuit developed by subev)nunlttee 1. was approved for use by all sub- 
eonuuLLLees. Two weeks later, the euuunittee passed on a revision of .the 
mission statement. 

Ihe I Ir.st dratt o\ the >^oaI statements was completed on November 
Lrt. l.l was then edited by a committee (Betty Lockwood, Ron Crossland, 
.iiul Don Haloj^J and submitted in December to four groups for evaluation: 
the Student-Senate Liaison Committee, the Teaching ' Faculty Executive 
C'.Mmuittee. Liie Administrative Council, and the Academic Council. Each 
Kioup was asked to determine if the suggested goals were appropriate y 
tor Delta College. In addition, each member of tha reviewing groups 
was .isked to look lor afeas that were important to the development of 
Delta College but not refKuted In the suggested goal statements. 

Sjj>^t_l_U; In meetings held during January and February, the 
ri'conmiendat Ions ot the t our ^^roups that reviewed t le suggested goals 
were evaluated, ana a t inal draft ot the goals was developed. On 
Kebruavv committee U^^>lson, Marsico, McCivern, and Packwood) was 

asked to r-ropan- a «iues t iv>nna I re consisting of the major and supportive 
goal statements. On Kebruary 1.1, the committee reviewed and accepted 
two new gvMl statements submitted by the Academic Council. Gene Pack^ 
wooil w.is given the responsibility of distributing the questionnaires 
to the members oi the Assembly and assembling the results for analysis. 
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At'tt'i* tliL! pri'paiat Loii o! iIil* Mission S Latt'nioiu , \^) Major GuaiH aiul LLO 
SuppurL Ln^ (loal SuuL-mtMils wrre ilevo 1 opinl l)y tliu Co1U«^l» Goals Com- 
miltt'i' aiul ri'vlrwt'd |)y tlic Tim^IiLiik KariiLty Kxot'utivL' CoauuiltfC, Aca- 
diMii Lo Cluuiu' 1 1 , Admin ist rMl Lvo Couiu lL, and Scnate-Stndeut Liaison 
CoumiUtut?. TliL-n tlu* rc'vLsi'd statLMiKMUs were s.lmU to all Senate Assem- 
lily iiUMiiliiMrs tor tlieLr i:L',u'tlon. A questionnaire was developed and 
piloted on the liolLe^e iloals L'onmilttee. Assembly members were disked 
to rate I) the importance ot eaeh major ^oal and supporting i4t)al to 
Delta C'oile^e, and 2) the priority (compared with present priority 
rat lu>;) that should he plac ed on each supporting K'Jal over the next une 
to t 1 ve vears . 

l)nrin>; February l^)/h, i|ut»stionnaires were sent tu the 266 Senate 
AssiMiibly niemhtTS. Kach senator was asked to contact the members in his 
or hei* unit to eni'oura^e them to complete the questionnaire. Tliere 
were liH questionnaires returned^ for a 52 percent return rate* 

The Assembly niemln rs who responded to the questionnaire felt as a 
>;roup that all the major y;oa I statements and supporting ^oal statements 
'were ot at leist average Importance. As a ^roup, they recommended thtit 
the Individual support toy; >;oa 1 statements receive approximately the 
same or slik;l\tly hl^lu'r priority than they are currently receiving. 
While Individuals dlllered in the Importance they placed on certain 
>;oals, uo i;oal statement was perceived by the ^roup as bein^ inappro- 
priate, tor IK'lta l'olle>;t». Tbi»se results represent the opinions of 
sll^btly more than halt tlu» Assembly members, and tberefore, should be 
used as an ad)nnct to other tnfcu'matlon Delta has pertaluln>; to those 
areas but should not be interpreted as absolute. 





'nu» proposoil MlssiDU StatcnKMiL dud Major dual SLaLemenL8 wore placed on 
thu Sciiati' ciKi'uda \v tho April L4, 1976 muetlnK. The Senate waa asked 
Lo a|)pn.y*. lUv MissLun StatcmuuL and the 19 Mi)or Goal Statements. The 
chairman ot tht» Cioals Conunlttt^e indicated that the Supporting Goal 
Slatenuuus wonld he liu Inded In the lull report ot the conunlttee. The 
Senate approved the statements and recommended that they be transmitted 
'tu the Bi.ard ol Trustees lor approval. On May 11, 1976, the Board of 
Trustei's ol Delta Col lege approved the Mission Statement and the 19 
Major Coal Statements. As a result ot the trustees* action, the state- 
ments will now be used in the coliefie catalog and other official college 
pubUealloiis, Inclusion ot the nuw Missions Statement and GoaTs should 
stn'ny;then the philosophical foundations of the college and more clearly 
rtM>re,sent the Intent ot Delta College. 

rhe^colLeKe is now in the process of developing college-wide and 
departmental objectives in line with these goals. The Research and De- 
velopment 01 fire at Delta was fortunate in being able to obtain the 
Aclvcuicod Institutional Development Grant, a small percentage of which 
provided tlie resourres and impetus for these goals and objectives-set- 
ting artLvities. but the KW staff were also able to provide some as- 
sistance to the various otfiees and committees that worked on these 
goals. Not only does the rollege now have a conceptual framework for 
policy and planning, but its K&D office has a conceptual framework for 
institutional research In these goals and objectives. 

Alter having t^a id all this, let me also point out that the Office 
of Research and Development at Delta came into existence in 1967, at 

18/i 
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Llii- refjiu'SL ot lUv tarulty when wt» conducted our Instl Lutiunal self- 
atiuly ill preparat Ldu tor r^^vlfw by tlu» North Central Association, Like 
most other Liistltut Inii.i L research ot flcos, ours has existed until now 
wLlhouL this coai-eptu.i 1 tramework, How can institutional reseurcli needs 
bi* Lilcntilled without resortiuK to a lar^c-scale effort of this kind, 
it loi-al c in*uiiist.inccs do not warrant this kind ol major research ef- 
lortV 

One tecluilque that has been used with success in some institutions 
is the establishment ot a research committee. If the research commit- 
tee is smal L euouKh to develop discussion, representative enough of the 
instUuliou as a whole to avoid biasing the concentration of effort of 
the researi'h ottlce, and Is used to Identify needs areas ratlier than to 
review e.ich requi»st tor research, It can be a very effective device, 

Ani»Llier method is to employ research techniques to identify your 
own resiMich needs priorities, Sample Interviewing of various members 
ot the stuilent bi>dy, taciiity, and administrative staff could yield di- 
rection for research needs, (Since others at this conference will be 
spi^akln^ vibout research techniques, L will make no attempt to identity 
those thvil could be appllcil to this problem,) 

(Jlveu tlie manner In which our own oil Ice war: established and the 
InstUntional dynamics we happen to have, we have found that to do a 
good job tor one rc»questor generates five more requests, We have found 
that requestor priorities tend to sort themselves out if we ask about 
the object Ives ot the ri'search to he done and the obje.: lives of the 
activity to be reviewed, It we ask people to vork with us in develop-- 
lug tUm*f.ables and tU>lng much of the work themselves, which has become 
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nect^sHary due to the Limited rt'sourcfs we havt*. Asking people who re- 
qut'at rcsLMr::h to bcc:umu direk'tiv invoivt^d in the research has another 
beiieilL ot uHsurliiK that the research Is actually used tor decision 
nuikliiK by l\\c rc<[uestur. Because ot this we continue to Involve re- 
questors Lii doLu>; tho research .even it' we are not short-handed, 

Auolher tacloc that tends to sort out true priorities and to en- 
sure more t'Uec-.tlve use ot our otl ice as a- resource is our policy that 
resetireli iloue tor one requestor will nut be released to another person • 
witliout an author Lzat Ion t rom the original requestor. This means that 
we do uoL become an "Inspector general" tor the administration or fac- 
ulty. We also tisk oil Ices to work together where research crosses 
Jurlsd Lttloual lines; that is, it one office requests research about 
the oiieratlou ot another, we ask both to. work together to develop the 
neresstiry investigation. Lt is rarely necessary to invoke these pol- 
icies, but whi'n it In, they tend to keep us out of institutional poli- 
t It -^i ,u)d preserve owr impartiality, without wliich much of our work 
would l>e useless, 

rhese LL'cluiiques havi' heJpea us keep i iii renu on. trends affecting 
our i nsL LluI Ion , and we continue to work toward the impossible goal of 
an ide.il Institutional rese.uth oltice. 
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IS INFORMATION POWER? 

Leslie Myies 
Director of Research and Development 
Delta College 
University Center* Michigan 

in looking at the relationship between federal and state agencies and 
local educational institutions, one should start with a clear under- 
standing that the picture is totally unclear. Higher (or postsecon- 
dary) education (we don't even know exactly what to call it) is in a 
state of confusion. Clark Kerr, in an address presented at the 26th 
National Conference on Higher Education in 1971(7), said: 

Higher Education in the United States is facing a period of un- 
certainty, confusion, conflict, and potential change. . .higher 
education is faced with a staggering number of uncertainties: 
(1) the direction of change that will be taking place in a 
society that is ever more divisive, and in a world that is 
undergoing a cultural revolution; (2) the impact of the new 
educational technology; (3) its proper functions in terms of 
teaching, research and services; (4) the governance of the in- 
stitutions; and (5) financing. 

Speaking at the 56th Annual Meeting of the American Council on Educa- 
tion in 1973, Stephen K. Bailey(8) agreed that 

Today, we scarcely know who we are, let alone who's in charge. \ . 
The more expensive we become, the more suspicious our protectors 
and providers become. . .we have a reputation — at least In some 
quarters of our nation's capital ~ for being exclusive, self-in- 
dulgent, patronizing, and sloppy. . .Eight thousand tax-paying 
proprietary schools want to know why training a historian for 
unemployment at the taxpayers' expense is better than training 
an ciccountant tor useful employment at the learner's expense. 
And parents and legislators are listening for our answer or at 
least for an intelligible and defensible rephrasing of the 
question. 

The federal government is no better off. In a delightfully 
mind-boggling report for the National Center for Educational Statistics 
In 19"/'3, Pamela Chrisuot f el and Lois Rlce(3) pointed out that "The vast 
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rauHe ot Fedoral po*:tsej:ondary progrumH has been called a shopping list 
in search ot a rationait: 

Civeii this Lack ot clear policy direction, it i« downright alarm- 
ing to have to agree with tlie Second Newman Report(17) that "a sense 
ul Legitimacy tor an issue of educational policy is often created by 
the existence of a federal program/' 

Most observers of this confused scene seem to believe that It 
you think that's bad, wait till you look at conditions in the 50 
states. The request for proposals that generated the Christof f el/Rlce 
report characterizes the Common Core of Data (CCD) Program of the 
National Center for Educational Statistics (NCES) as "a major new con- 
cept of the U.S, Office of Education intended to replace the current 
uneven and largely inadequate provision for education statistics in 
the 50 states, six outlying areas, and the District of Columbia, , /* 
(There are exceptions, and 1 share the speaker's table today with an 
outstanding one: Ivan Lach provides the Illinois Community Colleg*^ 
Board and the Illinois community colleges with the kind of research 
expertise and cooperative approach to expanding knowledge of the 
educaticMi tiuterprise which is the envy of many in the surrounding 
states,) 

The ijuestion ot Dollars 

Before the rolationsMp between federal and state agencies and 
educational institutions is discussed for long, the question of 
dollars will inevitably arise. Some of us might question the state- 
ment made by Paul Wing and Leonard Romney(19) In October 1974 that 
**lt is Important to note ttiat state agencies probably have a legit i- 
miito rlglit lo any institutional data at any level that could help them 
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4ddruaH important decisions and policy questions » particularly if 
they provide financial support to the institution/* 

However, It is difficult to argue with the proposition that if the 
federal or titate agency is providing financial support, it has a right 
to. know how its dollars are being spent and specifically, whether the 
goals of the funding are being advanced, Thn issues seem to involve 
kinds of data required, extent of data required in relation to finan- 
cial support received,' and the extent to which receipt of financial 
support entitles supporters to influence goals, objectives, and pol- 
icies of the institution. These are not easy questions. Does giving 
you money to make your building barrier-free to physically handicapped 
persons give me a right to know that once in the door, those studenttfi 
really do find a teaching/learning environment that helps overcome 
learning barriers caused by their handicaps? If so, which questions 
are legitimate ror me to ask to find that out? 

Most experienced administrators know that a key to effective 
management Is an effective management information system. If you 
don't know what's going on, you can't run a college. Now if you fol- 
low tliat rationale and if you want to maximize the control the col- 
lege maintains over its own functioning and minimize the control 
external agtMiciuH can exert, then you will resist step by step the 
data encroachments which those external agencies are making. If you 
also believe that it is the nature of bureaucracy, your own included, 
ti) preserve LtHelt and to grow, then you will assume that state and 
federal bureaucracies will, by theJr nature, want to preserve them- 
selves and to grow, and that this may happen at your expense • Ben 
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Lawrence, Director uL the National Center for Higher Education Manage- 
ment Systems, in his remarks before the 1976 National AsaemblyClZ), 
paraphrased St. John as folic ws: "In the beginning was information — 
and lnformatii:n Is power." These assumptions will provide aOded incen- 
tive to resist the data demanus of state and federal agencies. 

But tt seems to me that tor both realistic and idealistic rea- 
Si)ns» a goLid argument could be made against such resistance. Realis- 



tically, both state and federal agencies and our colleges recognize , 
that, to paraphrase Pogo. "Wc have met the taxpayer, and he is us." 
When candidates ru;. on the issues of zero budgeting and c^^tting 
bureaucracy, they are addressing all of us, and I suspect that a num- 
ber ot people here in the room support those concepts. If you^, support 
the loucept of management by objectives, it is difficult to quarrel ' 
with the gentleman from deorgia when he advocates the concept of zero ' 
budgeting. And that brings me to the idealistic level. An institu- 
tional researcher who believes in educational objectives, criterion- 
referenced testing, and developing improved measures of the outputs of 
pi)stsecund«iry education must experience considerable cognitive dis- 
sonance when he refuses to work with external agencies to develop data 
tor rational decision making. 

In short, I think thtit for realistic reasons we must cooperate 
with stiite and feder«il agencies in the provision of data because the 
taxpayers and their representatives will insist on some information, 
anil we had better help ensure that it is reasonably related to the 
goals and objectives stated and that it is used appropriately. I 
think th«it \ov i.de«iiistic reasons, we must cooperate to improve data 
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and data analysis tor dfclslon making If we are to be true to our 
emerglnK l-n.teaslun of Institutional research, which Is generated by 
the concept of rational decision making based on factual Information. 

Some Common I 'rub lems 

There remain, however, some serious" problems. The following Is cer- 
tainly not an exhaustive list, but the Items Included should serve to 
initiate some discussion. Some conmion problems are- that :. 

Data Is requested that Is not used . If there Is an Inor- 
dinately long turnaround time In reporting the results of data or If 
It Is widely known that most respondents to a particular report do not 
treat It seriously, neither the Institutional research officer nor the 
Institution which employs him Is likely to favor an extensive Invest- 
ment of his time in developing good data for such reports. 

Data reque sted is Irrelevant or misleading. Some believe, 
tor example, that reports such as the Higher Education General Survey 
(HKGIS) Degrees and Other Formal Awards Conferred give a false im- 
pression of productivity at community colleges. Although they have 
tew graduates as a total perrentage of their student population, com- 
munity eoili-nes nevertheless meet the objectives of a large number of 
their students who I ind Jobs or go to transfer institutions or re- 
ceive advancements as a result of their community college education. 
Modlt U-.iLlon ol some data, requests to fit student objectives may be 
In order. 

^' Data already available elsewhere is requested again . Appli- 
cations for Title Hi and Title VI funding, to cite cwo examples, re- 
quest data which has already hi \ provided in the Higher Education 
Cener.il Inl urmiitlon Survey. 
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4. Respou dt'utH du not know why data is requested. There io a 
dual reHponHibliity here: tor institutions to be informed and for 
dKencies to provide rationales explaining the relationship of data re- 
quests Lo program ohJe^.'tives. 

^ • Hespuudents lack resources to provide the data r equested • It 
Ls always helpful to review data requests from time to time to sort 
out which Informiition Ls really needed and being used for decision 
making and which was simply included on the form because it was some- 
thing that was "nice to know/' Smaller institutions, that lack the 
time and hardware to cope with detailed questionnaires especially re- 
sent data requests which require considerable research expertise and 
computer resources. 

t)ata requested to check progress on one goal may inhibit 
progress toward another . An example of this is the use of the Costing 
and Data Management System of tht! National Center for Higher Education 
MiUmgemeut Systems (NCHEMS) . Although NCHEMS in its Information Ex- 
change Procedures project and now in its wide-scale implementation 
prt>|ect cautions that cost data should not be compared without at the 
same time comparing program objectives, the message has not been 
heard by every agency. The concern that some institutions have is that 
a Jegitimate retjuest by state agencies for comparative cost data on the 
programs they are lunding may Inhibit diversity in postsecondary educa- 
tion, and dtversltv Is a goal of American postsecondary education, 

7. Data requested does not reflect legislative intent . Since 
legLsJaLliMi is the result of compromise, the intent of the legislature 
with regard lu specit ic programs is sometimes not clear. When the 
agency responsihle lor implementing the legislation also issues 
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ruKulationa and requests data, the institutions; that receive these 
requests may feel that they do not roflect legislative intent. 

**• Data is requested on a numbjr of goals not related to the 
program tor which the college has requested funds . Acceptance of 
agency funds roquiies assurance of compliance with Title VII, 
Title IX, and a number of other legislative, regulatory, and executive 
order requirements. Some institutions may be willing to assure that 
thoy are making a good-faith effort to achieve these goals but resent 
the direct involvement of federal agencies in the development of in- 
stitutional self-assessments, affirmative action plans, and so on. 
The recent Title IX protests of Brigham Young University and Hillsdale 
College are particularly Interesting in this regard. They are pro- 
testing the federal government's direct involvement in their institu- 
tions because their students, not the institutions, have received fed- 
eral assistance. Proponents of the voucher idea in which students 
can "vote with tlieir feet" for the school that best meets their objec- 
tives sl.ould be particularly interested in the questions raised by 
these two scliools. As with most of the criticisms cited above, there 
are Intelligent people of good will fo.ind on both sides, and the 
answers are not so apparont as they mij-ht appear to be. As Wing and 
Komnev(l^) a^roe, 

ivterminatlon vi the most appropriate information and assLci- 
ated level oi detail is a matter that should, if possible, be 
determined jointly by the agencies and institutions concerned, 
based on their respect i-e needs and capabilities. Needless to 
say, the t InaJ location of the "boundary" between fnstitu- 
tioiKil and state- love I responsibilities will vary from state 
to state. 
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And tluy add, Interestingly, 
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It ia important to remember that the locus of declslor- 
makLiK responaibllity is not a simple function of size or 
any other single criterion, and for every rule of thumb 
that one can propose, there probably will be several ex- 
ceptiw>ns among the fifty states. 

This would seem to suggest that the locus of decision-making should be 
determined by logic, L should like to suggest, however, that logic 
has little to do with the locus of decisif>n making. If it did, the 
resource and boundary questions in the Middle East could have been 
settled long ago. The locus of decision making is determined by pol- 
itical actii)n based on power. And that brings us full circle, back to 
the power of economics and the relative power and decision-making 
authority ot our colleges, the states, and the federal government. 
To quote Stephen K, Bailey again, we are facing 

... a persistent human paradox: the simultaneous need for 
structure and tor ant istructure , for dependence and for 
autonomy, for involvement and for privacy, for community 
anJ for identity. Today, as we perceive this elemental 
paradox in' the tensions between the academy and the state, 
it is useful to keep in mind its generic quality. For at 
heart we are dealing, 1 submit, with a dilemma we cannot 
rationally wish to resolve. The public interest would not, 
in ray estinvition, he served if the academy were to enjoy 
an untroubled immunity. Nor could the public interest be 
served by the academy/ s being subjected to an intimate 
surve illance . 

In l\is remarks before the 1976 National Assembly of the National 
Center tor Higher Kducation Management Systems, Governor Richard Lamm 
of Colorai!o(ll) statd that some suggest higher education has traded 
its autonomy fur state and federal funding and warned that the ^'almost 
. /♦5-dev;reo angle of tho increase in total appropriations for higher 
eilurat ion In rt'rent ye.irs gives one pause.'* 
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Many observers, including those of us in postsecondary education, 
have been niven pause by the nrowth curve in higher education enroll- 
ments and costs over the past 15 years. Many observers, especially 
those v*u> wunder about the efficiency and effectiveness of post- 
secondary education, have compared these growth curves to the fever 
charts of state and local economies, the cost of living, the propor- 
tionate Increase in costs of other public and quasi-public services, 
and have concluded that postsecondary education which receives public 
funds must be made accountable to those who pay the bills, I would 
not attempt to del Lnc accountability in this highly political context 
or set any precise boundaries on the data needs of state and federal 
governments In order to arrive at accountability, However, let m: 
state uneqiiivi>cally that there are very few remaining in r jstsecondary 
education, and particularly in t:omiT»unity and junior colleges, who 
would dispute the need for accountability, I strongly support it. 
But I would ask whether the growth curves of enrollments and costs in 
postsecondary education are being viewed in the proper context. 

It yi)U believe that the growth curves in postsecondary education 
are alarming, those suggested by futurists such as Alvin Toffler in 
his Future Shock are absolutely terrifying. If 90 percent of the 
scientists who ever lived are alive today, and if the growth curve 
tor lutiire change is almost perpendicular, as Toffler suggests, then 
perhaps the 43-degree angle of growth cited by Governor Lamm is 
alarming, m)t because it is too high, but rather because it is only 
halt as steep as it ought to be. 




Some Final Questions 

Let me leave you with these qutistlons: 

• What is the responsibility of postsecondary education to pre- 
pare the society to cope with an ever-accelerating pace of 
change? ^ 

• What Is the responsibility of state and federal governments 
to invest in preparing society for that change? 

• What are reasonable levels of investment? 

• Wliat are reasonable criteria to define the educational 
products and Investments required? 

• What are the data needs of postsecondary education institu- 
tions, state governments, and the federal government to 
determine if those criteria are being met? 

There ought to be more forums such as the Assemblies called by 

the National Center fo.r Higher Education Management Systems at which 

tnese questions are debated. 
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